Apr 09 17:26:59 devstack cinder-volume[72878]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 17:26:59 devstack cinder-volume[72878]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 17:26:59 devstack cinder-volume[72878]: we strongly recommend against using it for new projects. Apr 09 17:26:59 devstack cinder-volume[72878]: If you are already using Eventlet, we recommend migrating to a different Apr 09 17:26:59 devstack cinder-volume[72878]: framework. For more detail see Apr 09 17:26:59 devstack cinder-volume[72878]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 17:26:59 devstack cinder-volume[72878]: import eventlet # noqa Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:27:01 devstack cinder-volume[72878]: INFO dbcounter [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Registered counter for database cinder Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG oslo_db.sqlalchemy.engines [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG dbcounter [-] [72878] Writer thread running {{(pid=72878) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 17:27:01 devstack cinder-volume[72878]: INFO cinder.rpc [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 17:27:01 devstack cinder-volume[72878]: INFO cinder.rpc [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG oslo_db.sqlalchemy.engines [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:27:01 devstack cinder-volume[72878]: INFO cinder.volume.manager [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Determined volume DB was empty at startup. Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG cinder.volume.manager [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72878) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 17:27:01 devstack cinder-volume[72878]: INFO cinder.volume.manager [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 17:27:01 devstack cinder-volume[72878]: WARNING stevedore.named [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 17:27:01 devstack cinder-volume[72878]: WARNING castellan.key_manager [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:27:01 devstack cinder-volume[72878]: WARNING cinder.keymgr.conf_key_mgr [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG cinder.volume.drivers.lvm [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72878) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 09 17:27:01 devstack cinder-volume[72878]: DEBUG oslo_concurrency.processutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72878) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_concurrency.processutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] CMD "cinder-rtstool verify" returned: 0 in 0.260s {{(pid=72878) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_db.sqlalchemy.engines [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:27:02 devstack cinder-volume[72878]: INFO cinder.rpc [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 09 17:27:02 devstack cinder-volume[72878]: INFO cinder.rpc [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 09 17:27:02 devstack cinder-volume[72878]: WARNING stevedore.named [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 17:27:02 devstack cinder-volume[72878]: WARNING castellan.key_manager [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:27:02 devstack cinder-volume[72878]: INFO cinder.volume.manager [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_db.sqlalchemy.engines [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72878) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:27:02 devstack cinder-volume[72878]: INFO oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Starting 1 workers Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Started child 72987 {{(pid=72878) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Full set of CONF: {{(pid=72878) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] ******************************************************************************** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Configuration options gathered from: {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] ================================================================================ {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] allow_availability_zone_fallback = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] allow_compression_on_image_upload = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] allowed_direct_url_schemes = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] api_rate_limit = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] auth_strategy = keystone {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] az_cache_duration = 3600 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_availability_zone = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_host = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_stats_polling_interval = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72987]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backup_api_class = cinder.backup.api.API {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backup_name_template = backup-%s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backup_use_same_host = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backup_use_temp_snapshot = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] chap_password = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] chap_username = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_internal_tenant_project_id = d1cb03009696487299309ab35a3c9a0d {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_internal_tenant_user_id = af9c146dadf0481592779e98d6785a4c {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cloned_volume_same_az = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cluster = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] compression_format = gzip {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] compute_api_class = cinder.compute.nova.API {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] config_dir = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] config_source = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] control_exchange = openstack {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] debug = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] default_availability_zone = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] default_group_type = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] default_volume_type = lvmdriver-1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] disk_geometry = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] driver_client_cert = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] driver_client_cert_key = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] driver_data_namespace = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] driver_ssl_cert_path = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] driver_ssl_cert_verify = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] driver_use_ssl = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] enable_force_upload = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] enable_new_services = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] enable_unsupported_driver = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] enforce_multipath_for_image_xfer = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] filter_function = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_api_insecure = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_api_ssl_compression = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_ca_certificates_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_catalog_info = image:glance:publicURL {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_num_retries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance_request_timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] goodness_function = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] graceful_shutdown_timeout = 5 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] group_api_class = cinder.group.api.API {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] host = devstack {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_compress_on_upload = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_conversion_address_space_limit = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_conversion_cpu_limit = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_conversion_disable = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_upload_use_cinder_backend = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_upload_use_internal_tenant = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_volume_cache_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_volume_cache_max_count = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] image_volume_cache_max_size_gb = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] init_host_max_objects_retrieval = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] instance_format = [instance: %(uuid)s] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] iscsi_target_flags = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] iscsi_write_cache = on {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] iser_helper = tgtadm {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] iser_ip_address = 192.168.122.149 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] iser_port = 3260 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_color = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_config_append = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_dir = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_options = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_rotate_interval = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_rotate_interval_type = days {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] log_rotation_type = none {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] max_age = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] max_logfile_count = 30 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] max_logfile_size_mb = 200 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] max_over_subscription_ratio = 20.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] message_reap_interval = 86400 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] message_ttl = 2592000 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] migration_create_volume_timeout_secs = 300 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] monkey_patch = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] monkey_patch_modules = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] my_ip = 192.168.122.149 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] no_snapshot_gb_quota = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] num_iser_scan_tries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] num_shell_tries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] num_volume_device_scan_tries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] nvmeof_conn_info_version = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] nvmet_ns_id = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] nvmet_port_id = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_max_limit = 1000 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_volume_ext_list = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_volume_listen_port = 8776 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_volume_use_ssl = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] osapi_volume_workers = 2 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] per_volume_size_limit = -1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] periodic_fuzzy_delay = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] periodic_interval = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] public_endpoint = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] publish_errors = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_backup_gigabytes = 1000 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_backups = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_gigabytes = 1000 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_groups = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_snapshots = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] quota_volumes = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] rate_limit_burst = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] rate_limit_except_level = CRITICAL {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] rate_limit_interval = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] reinit_driver_count = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] replication_device = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] report_discard_supported = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] report_interval = 120 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] reservation_clean_interval = 86400 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] reservation_expire = 86400 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] reserved_image_namespaces = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] reserved_percentage = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] rpc_response_timeout = 120 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] run_external_periodic_tasks = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] scst_target_driver = iscsi {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] scst_target_iqn_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_down_time = 720 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] shell_completion = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] snapshot_name_template = snapshot-%s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] snapshot_same_host = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] split_loggers = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] state_path = /opt/stack/data/cinder {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] storage_availability_zone = nova {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] storage_protocol = iSCSI {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] syslog_log_facility = LOG_USER {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] target_helper = lioadm {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] target_ip_address = 192.168.122.149 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] target_port = 3260 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] target_protocol = iscsi {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] target_secondary_ip_addresses = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] trace_flags = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] transport_url = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] until_refresh = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_chap_auth = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_default_quota_class = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_journal = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_json = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_multipath_for_image_xfer = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_stderr = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] use_syslog = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] verify_glance_signatures = enabled {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_api_class = cinder.volume.api.API {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_backend_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_clear = zero {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_clear_ionice = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_clear_size = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_copy_bps_limit = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_dd_blocksize = 1M {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_name_template = volume-%s {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_service_inithost_offload = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volume_usage_audit_period = month {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] zoning_mode = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_concurrency.disable_process_locking = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.admin_password = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.admin_token = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.admin_user = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_port = 35357 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_protocol = https {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_section = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_type = password {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_uri = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.auth_version = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.cache = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.identity_uri = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.include_service_catalog = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.insecure = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.interface = public {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_password = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcache_username = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.region_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.service_type = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.backend = dogpile.cache.null {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.backend_argument = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.backend_expiration_time = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.config_prefix = cache.oslo {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.debug_cache_backend = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.enable_retry_client = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.enable_socket_keepalive = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.enforce_fips_mode = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.expiration_time = 600 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.hashclient_retry_attempts = 2 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_dead_retry = 300 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_pool_maxsize = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_sasl_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.password = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.proxies = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.redis_db = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.redis_server = localhost:6379 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.retry_attempts = 2 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.retry_delay = 0.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.socket_keepalive_count = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.socket_keepalive_idle = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.socket_keepalive_interval = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.socket_timeout = 1.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.tls_allowed_ciphers = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.tls_cafile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.tls_certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.tls_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.tls_keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cache.username = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] coordination.backend_url = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.asyncio_connection = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.asyncio_slave_connection = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.backend = sqlalchemy {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.connection = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.connection_debug = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.connection_parameters = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.connection_recycle_time = 3600 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.connection_trace = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.db_inc_retry_interval = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.db_max_retries = 20 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.db_max_retry_interval = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.db_retry_interval = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.max_overflow = 50 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.max_pool_size = 5 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.max_retries = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.mysql_wsrep_sync_wait = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.pool_timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.retry_interval = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.slave_connection = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.sqlite_synchronous = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.synchronous_reader = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] database.use_db_reconnect = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.connection_string = messaging:// {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.es_doc_type = notification {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.es_scroll_size = 10000 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.es_scroll_time = 2m {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.filter_error_trace = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.hmac_keys = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.sentinel_service_name = mymaster {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.socket_timeout = 0.1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.trace_requests = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler.trace_sqlalchemy = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler_jaeger.process_tags = {} {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler_jaeger.service_name_prefix = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] profiler_otlp.service_name_prefix = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.enforce_new_defaults = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: WARNING oslo_config.cfg [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.enforce_scope = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.policy_default_rule = default {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.policy_file = policy.yaml {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.group = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.helper_command = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] privsep_osbrick.user = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.group = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.helper_command = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] cinder_sys_admin.user = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.auth_section = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.auth_type = password {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.cafile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.collect_timing = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.insecure = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.send_service_user_token = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.split_loggers = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] service_user.timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.auth_section = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.auth_type = password {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.collect_timing = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.insecure = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.region_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.split_loggers = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] glance.timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.backend_availability_zone = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.chap_password = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.chap_username = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.disk_geometry = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.driver_client_cert = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.driver_client_cert_key = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.driver_data_namespace = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.driver_use_ssl = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.extra_capabilities = {} {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.filter_function = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.goodness_function = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.iscsi_target_flags = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.iscsi_write_cache = on {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.iser_helper = tgtadm {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.iser_port = 3260 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.lvm_share_target = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.lvm_type = auto {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.num_shell_tries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.replication_device = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.report_discard_supported = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.reserved_percentage = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.target_helper = tgtadm {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.target_port = 3260 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.target_protocol = iscsi {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.trace_flags = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.unique_fqdn_network = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.use_chap_auth = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_backend_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_clear = zero {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_clear_ionice = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_clear_size = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_reports.file_event_handler = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_reports.log_dir = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.backend_host = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.chap_password = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.chap_username = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.disk_geometry = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.driver_client_cert = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.extra_capabilities = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.filter_function = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.goodness_function = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.iser_helper = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.iser_ip_address = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.iser_port = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.lvm_share_target = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.lvm_type = auto {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.num_shell_tries = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.replication_device = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.report_discard_supported = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.reserved_percentage = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.scst_target_driver = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.storage_protocol = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.target_helper = lioadm {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.target_ip_address = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.target_port = 3260 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.trace_flags = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.use_chap_auth = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_clear = zero {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_clear_size = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] lvmdriver-1.volumes_dir = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.ssl = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_notifications.driver = [] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_notifications.retry = -1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] key_manager.fixed_key = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.barbican_api_version = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.barbican_endpoint = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.barbican_endpoint_type = public {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.barbican_region_name = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.cafile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.collect_timing = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.insecure = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.number_of_retries = 60 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.retry_delay = 1 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.send_service_user_token = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.split_loggers = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.verify_ssl = True {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican.verify_ssl_path = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.auth_section = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.auth_type = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.cafile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.certfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.collect_timing = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.insecure = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.keyfile = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.split_loggers = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] barbican_service_user.timeout = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.approle_role_id = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.approle_secret_id = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.kv_mountpoint = secret {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.kv_path = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.kv_version = 2 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.namespace = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.root_token_id = **** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.ssl_ca_crt_file = None {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.timeout = 60.0 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.use_ssl = False {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:27:02 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] ******************************************************************************** {{(pid=72878) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:02 devstack sudo[72991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 09 17:27:02 devstack sudo[72991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:02 devstack sudo[72991]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:02 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:02 devstack sudo[73064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:02 devstack sudo[73064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:03 devstack sudo[73064]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:03 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.506s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:03 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:27:03 devstack cinder-volume[72987]: INFO cinder.brick.local_dev.lvm [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 09 17:27:03 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:03 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:03 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:03 devstack sudo[73326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:27:03 devstack sudo[73326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:04 devstack sudo[73326]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:04 devstack cinder-volume[72987]: DEBUG cinder.brick.local_dev.lvm [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72987) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 09 17:27:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:04 devstack sudo[73517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:04 devstack sudo[73517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:05 devstack sudo[73517]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.019s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:05 devstack sudo[73663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:05 devstack sudo[73663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:05 devstack sudo[73663]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:05 devstack sudo[73720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 09 17:27:05 devstack sudo[73720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:05 devstack sudo[73720]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.423s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:05 devstack sudo[73723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:27:05 devstack sudo[73723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:06 devstack sudo[73723]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:06 devstack sudo[73728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:27:06 devstack sudo[73728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:06 devstack sudo[73728]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:06 devstack sudo[73731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:06 devstack sudo[73731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:07 devstack sudo[73731]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:07 devstack sudo[73739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:07 devstack sudo[73739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:07 devstack sudo[73739]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:07 devstack sudo[73743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:07 devstack sudo[73743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:08 devstack sudo[73743]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:08 devstack cinder-volume[72987]: INFO cinder.volume.drivers.lvm [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:08 devstack sudo[73747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:08 devstack sudo[73747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:08 devstack sudo[73747]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 17:27:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:08 devstack sudo[73865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:27:08 devstack sudo[73865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:09 devstack sudo[73865]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:09 devstack sudo[73871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:09 devstack sudo[73871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:09 devstack sudo[73871]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:09 devstack sudo[74011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:09 devstack sudo[74011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:10 devstack sudo[74011]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:10 devstack sudo[74015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:10 devstack sudo[74015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:10 devstack sudo[74015]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:10 devstack cinder-volume[72987]: INFO cinder.volume.driver [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG cinder.volume.driver [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72987) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG oslo_db.sqlalchemy.engines [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72987) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writer thread running {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG cinder.db.sqlalchemy.api [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Building query based on filter {{(pid=72987) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG cinder.image.image_utils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72987) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 17:27:10 devstack cinder-volume[72987]: INFO cinder.keymgr.migration [None req-be575724-8069-4530-9109-52cd162d7d4e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 17:27:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:10 devstack sudo[74019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:27:10 devstack sudo[74019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:10 devstack sudo[74019]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:11 devstack sudo[74023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:11 devstack sudo[74023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:11 devstack sudo[74023]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:11 devstack sudo[74029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:11 devstack sudo[74029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:11 devstack sudo[74029]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:11 devstack sudo[74035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:11 devstack sudo[74035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:12 devstack cinder-volume[72878]: DEBUG dbcounter [-] [72878] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72878) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:27:12 devstack sudo[74035]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:27:12 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Driver initialization completed successfully. Apr 09 17:27:12 devstack cinder-volume[72987]: INFO cinder.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Initiating service 2 cleanup Apr 09 17:27:12 devstack cinder-volume[72987]: INFO cinder.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Service 2 cleanup completed. Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG cinder.service [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Creating RPC server for service cinder-volume {{(pid=72987) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG cinder.service [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72987) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 17:27:12 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:12 devstack sudo[74039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:27:12 devstack sudo[74039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:12 devstack sudo[74039]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:12 devstack sudo[74044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:12 devstack sudo[74044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:13 devstack sudo[74044]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:13 devstack sudo[74051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:27:13 devstack sudo[74051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:13 devstack sudo[74051]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:27:13 devstack sudo[74108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:27:13 devstack sudo[74108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:27:14 devstack sudo[74108]: pam_unix(sudo:session): session closed for user root Apr 09 17:27:14 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:27:14 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-5e665b49-b718-49be-83e0-f40877671f63 None None] Driver post RPC initialization completed successfully. Apr 09 17:27:24 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:SELECT=2 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:27:24 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:28:47 devstack cinder-volume[72987]: DEBUG oslo_service.periodic_task [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72987) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:28:47 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 17:28:47 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:28:47 devstack sudo[79099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:28:47 devstack sudo[79099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:28:47 devstack sudo[79099]: pam_unix(sudo:session): session closed for user root Apr 09 17:28:47 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:28:47 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:28:47 devstack sudo[79102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:28:47 devstack sudo[79102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:28:48 devstack sudo[79102]: pam_unix(sudo:session): session closed for user root Apr 09 17:28:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:28:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:28:48 devstack sudo[79105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:28:48 devstack sudo[79105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:28:48 devstack sudo[79105]: pam_unix(sudo:session): session closed for user root Apr 09 17:28:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:28:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:28:48 devstack sudo[79108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:28:48 devstack sudo[79108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:28:48 devstack sudo[79108]: pam_unix(sudo:session): session closed for user root Apr 09 17:28:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:28:48 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:29:24 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:29:47 devstack cinder-volume[72987]: DEBUG oslo_service.periodic_task [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72987) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:29:47 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 17:29:47 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:29:47 devstack sudo[81214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 17:29:47 devstack sudo[81214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:29:47 devstack sudo[81214]: pam_unix(sudo:session): session closed for user root Apr 09 17:29:47 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:29:47 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:29:47 devstack sudo[81217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:29:47 devstack sudo[81217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:29:48 devstack sudo[81217]: pam_unix(sudo:session): session closed for user root Apr 09 17:29:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.408s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:29:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:29:48 devstack sudo[81221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 17:29:48 devstack sudo[81221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:29:48 devstack sudo[81221]: pam_unix(sudo:session): session closed for user root Apr 09 17:29:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:29:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:29:48 devstack sudo[81235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 17:29:48 devstack sudo[81235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:29:48 devstack sudo[81235]: pam_unix(sudo:session): session closed for user root Apr 09 17:29:48 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:29:48 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-64268e45-8b15-434b-b1a8-f01e71912157 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:30:29 devstack cinder-volume[72878]: INFO oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Caught SIGTERM, stopping children Apr 09 17:30:29 devstack cinder-volume[72878]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Acquiring lock "singleton_lock" {{(pid=72878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:30:29 devstack cinder-volume[72878]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Acquired lock "singleton_lock" {{(pid=72878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:30:29 devstack cinder-volume[72878]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Releasing lock "singleton_lock" {{(pid=72878) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:30:29 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Stop services. {{(pid=72878) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 09 17:30:29 devstack cinder-volume[72878]: DEBUG oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Killing children. {{(pid=72878) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 09 17:30:29 devstack cinder-volume[72878]: INFO oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Waiting on 1 children to exit Apr 09 17:30:32 devstack cinder-volume[72987]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Acquiring lock "singleton_lock" {{(pid=72987) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:30:32 devstack cinder-volume[72987]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Acquired lock "singleton_lock" {{(pid=72987) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:30:32 devstack cinder-volume[72987]: DEBUG oslo_concurrency.lockutils [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Releasing lock "singleton_lock" {{(pid=72987) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:30:32 devstack cinder-volume[72987]: WARNING amqp [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 17:30:32 devstack cinder-volume[72987]: WARNING amqp [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 17:30:32 devstack cinder-volume[72878]: INFO oslo_service.backend._eventlet.service [None req-ffcc5f0c-fd34-44f9-9798-f12c2cfc4386 None None] Child 72987 exited with status 0 Apr 09 17:30:32 devstack cinder-volume[82223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 17:30:32 devstack cinder-volume[82223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 17:30:32 devstack cinder-volume[82223]: we strongly recommend against using it for new projects. Apr 09 17:30:32 devstack cinder-volume[82223]: If you are already using Eventlet, we recommend migrating to a different Apr 09 17:30:32 devstack cinder-volume[82223]: framework. For more detail see Apr 09 17:30:32 devstack cinder-volume[82223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 17:30:32 devstack cinder-volume[82223]: import eventlet # noqa Apr 09 17:30:34 devstack cinder-volume[82223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82223) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:30:34 devstack cinder-volume[82223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82223) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:30:34 devstack cinder-volume[82223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82223) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:30:35 devstack cinder-volume[82223]: INFO dbcounter [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Registered counter for database cinder Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG dbcounter [-] [82223] Writer thread running {{(pid=82223) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 17:30:35 devstack cinder-volume[82223]: INFO cinder.rpc [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 17:30:35 devstack cinder-volume[82223]: INFO cinder.rpc [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:35 devstack cinder-volume[82223]: INFO cinder.volume.manager [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Determined volume DB was empty at startup. Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG cinder.volume.manager [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82223) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 17:30:35 devstack cinder-volume[82223]: INFO cinder.volume.manager [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 17:30:35 devstack cinder-volume[82223]: WARNING stevedore.named [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 17:30:35 devstack cinder-volume[82223]: WARNING castellan.key_manager [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:30:35 devstack cinder-volume[82223]: WARNING cinder.keymgr.conf_key_mgr [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:30:35 devstack cinder-volume[82223]: INFO cinder.volume.manager [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_db.sqlalchemy.engines [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:35 devstack cinder-volume[82223]: INFO oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Starting 1 workers Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Started child 82337 {{(pid=82223) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Full set of CONF: {{(pid=82223) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] ******************************************************************************** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Configuration options gathered from: {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] ================================================================================ {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] allow_availability_zone_fallback = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] allow_compression_on_image_upload = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] allowed_direct_url_schemes = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] api_rate_limit = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] auth_strategy = keystone {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_availability_zone = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_host = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_stats_polling_interval = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backup_api_class = cinder.backup.api.API {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backup_name_template = backup-%s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backup_use_same_host = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backup_use_temp_snapshot = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] chap_password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] chap_username = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_internal_tenant_project_id = d1cb03009696487299309ab35a3c9a0d {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_internal_tenant_user_id = af9c146dadf0481592779e98d6785a4c {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cluster = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] compression_format = gzip {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] compute_api_class = cinder.compute.nova.API {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] config_dir = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] config_source = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] control_exchange = openstack {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] debug = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] default_availability_zone = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] default_group_type = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] default_volume_type = QuobyteHD {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] disk_geometry = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] driver_client_cert = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] driver_client_cert_key = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] driver_data_namespace = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] driver_ssl_cert_path = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] driver_ssl_cert_verify = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] driver_use_ssl = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] enable_new_services = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] enable_unsupported_driver = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] enabled_backends = ['QuobyteHD'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] enforce_multipath_for_image_xfer = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] filter_function = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82337]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_api_insecure = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_api_ssl_compression = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_ca_certificates_file = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_catalog_info = image:glance:publicURL {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_num_retries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance_request_timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] goodness_function = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] graceful_shutdown_timeout = 5 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] group_api_class = cinder.group.api.API {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] host = devstack {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_compress_on_upload = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_conversion_address_space_limit = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_conversion_cpu_limit = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_conversion_disable = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_upload_use_cinder_backend = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_upload_use_internal_tenant = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_volume_cache_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_volume_cache_max_count = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] image_volume_cache_max_size_gb = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] init_host_max_objects_retrieval = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] instance_format = [instance: %(uuid)s] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] iscsi_target_flags = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] iscsi_write_cache = on {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] iser_helper = tgtadm {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] iser_ip_address = 192.168.122.149 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] iser_port = 3260 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_color = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_config_append = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_dir = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_file = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_options = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_rotate_interval = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_rotate_interval_type = days {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] log_rotation_type = none {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] max_age = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] max_logfile_count = 30 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] max_logfile_size_mb = 200 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] max_over_subscription_ratio = 20.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] message_reap_interval = 86400 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] message_ttl = 2592000 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] migration_create_volume_timeout_secs = 300 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] monkey_patch = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] monkey_patch_modules = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] my_ip = 192.168.122.149 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] no_snapshot_gb_quota = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] num_iser_scan_tries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] num_shell_tries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] num_volume_device_scan_tries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] nvmeof_conn_info_version = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] nvmet_ns_id = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] nvmet_port_id = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_max_limit = 1000 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_volume_ext_list = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_volume_listen_port = 8776 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_volume_use_ssl = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] osapi_volume_workers = 2 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] per_volume_size_limit = -1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] periodic_fuzzy_delay = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] periodic_interval = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] public_endpoint = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] publish_errors = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_backup_gigabytes = 1000 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82337]: INFO cinder.volume.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_backups = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.remotefs [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82337) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_gigabytes = 1000 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_groups = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_snapshots = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] quota_volumes = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] rate_limit_burst = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] rate_limit_except_level = CRITICAL {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] rate_limit_interval = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] reinit_driver_count = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] replication_device = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] report_discard_supported = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] report_interval = 120 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] reservation_clean_interval = 86400 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] reservation_expire = 86400 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] reserved_image_namespaces = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] reserved_percentage = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] rpc_response_timeout = 120 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] run_external_periodic_tasks = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] scst_target_driver = iscsi {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] scst_target_iqn_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_down_time = 720 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] shell_completion = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] snapshot_name_template = snapshot-%s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] split_loggers = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] state_path = /opt/stack/data/cinder {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] storage_availability_zone = nova {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] storage_protocol = iSCSI {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] syslog_log_facility = LOG_USER {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] target_helper = lioadm {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] target_ip_address = 192.168.122.149 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] target_port = 3260 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] target_protocol = iscsi {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] target_secondary_ip_addresses = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] trace_flags = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] transport_url = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] until_refresh = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_chap_auth = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_default_quota_class = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_journal = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_json = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_multipath_for_image_xfer = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_stderr = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] use_syslog = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] verify_glance_signatures = enabled {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_api_class = cinder.volume.api.API {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_backend_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_clear = zero {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_clear_ionice = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_clear_size = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_copy_bps_limit = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_dd_blocksize = 1M {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_name_template = volume-%s {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_service_inithost_offload = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volume_usage_audit_period = month {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] zoning_mode = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_concurrency.disable_process_locking = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.admin_password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.admin_token = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.admin_user = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_port = 35357 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_protocol = https {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_section = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_type = password {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_uri = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.auth_version = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.cache = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.identity_uri = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.include_service_catalog = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.insecure = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.interface = public {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_password = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcache_username = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.region_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.service_type = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.backend = dogpile.cache.null {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.backend_argument = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.backend_expiration_time = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.config_prefix = cache.oslo {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.debug_cache_backend = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.enable_retry_client = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.enable_socket_keepalive = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.enforce_fips_mode = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.expiration_time = 600 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.hashclient_retry_attempts = 2 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_dead_retry = 300 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_pool_maxsize = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_sasl_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.proxies = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.redis_db = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.redis_server = localhost:6379 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.retry_attempts = 2 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.retry_delay = 0.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.socket_keepalive_count = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.socket_keepalive_idle = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.socket_keepalive_interval = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.socket_timeout = 1.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.tls_allowed_ciphers = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.tls_cafile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.tls_certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.tls_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.tls_keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cache.username = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] coordination.backend_url = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.asyncio_connection = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.asyncio_slave_connection = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.backend = sqlalchemy {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.connection = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.connection_debug = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.connection_parameters = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.connection_recycle_time = 3600 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.connection_trace = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.db_inc_retry_interval = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.db_max_retries = 20 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.db_max_retry_interval = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.db_retry_interval = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.max_overflow = 50 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.max_pool_size = 5 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.max_retries = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.mysql_wsrep_sync_wait = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.pool_timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.retry_interval = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.slave_connection = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.sqlite_synchronous = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.synchronous_reader = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] database.use_db_reconnect = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.connection_string = messaging:// {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.es_doc_type = notification {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.es_scroll_size = 10000 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.es_scroll_time = 2m {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.filter_error_trace = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.hmac_keys = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.sentinel_service_name = mymaster {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.socket_timeout = 0.1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.trace_requests = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82337) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler.trace_sqlalchemy = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler_jaeger.process_tags = {} {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler_jaeger.service_name_prefix = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] profiler_otlp.service_name_prefix = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.enforce_new_defaults = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82337]: WARNING cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 09 17:30:35 devstack cinder-volume[82337]: WARNING cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 09 17:30:35 devstack cinder-volume[82223]: WARNING oslo_config.cfg [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.enforce_scope = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.policy_default_rule = default {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Running cmd (subprocess): mount.quobyte {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.policy_file = policy.yaml {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.group = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.helper_command = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] privsep_osbrick.user = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.group = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.helper_command = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] cinder_sys_admin.user = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.auth_section = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.auth_type = password {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.cafile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.collect_timing = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.insecure = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.send_service_user_token = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.split_loggers = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] service_user.timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.auth_section = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.auth_type = password {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.collect_timing = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.insecure = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.region_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.split_loggers = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] glance.timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.backend_availability_zone = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.chap_password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.chap_username = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.disk_geometry = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.driver_client_cert = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.driver_client_cert_key = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.driver_data_namespace = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.driver_use_ssl = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.extra_capabilities = {} {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.filter_function = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.goodness_function = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.iscsi_target_flags = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.iscsi_write_cache = on {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.iser_helper = tgtadm {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.iser_port = 3260 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_host = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_login = admin {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_mount_options = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_private_key = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_share_path = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.num_shell_tries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.quobyte_volume_url = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.replication_device = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.report_discard_supported = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.reserved_percentage = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.target_helper = tgtadm {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.target_port = 3260 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.target_protocol = iscsi {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.trace_flags = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.unique_fqdn_network = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.use_chap_auth = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_backend_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_clear = zero {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_clear_ionice = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_clear_size = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_reports.file_event_handler = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_reports.log_dir = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.backend_availability_zone = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.backend_host = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.chap_password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.chap_username = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.chiscsi_conf = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.disk_geometry = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.driver_client_cert = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.driver_data_namespace = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.driver_use_ssl = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.extra_capabilities = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.filter_function = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.goodness_function = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.iser_helper = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.iser_ip_address = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.iser_port = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.iser_target_prefix = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_host = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_login = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_mount_options = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_password = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_private_key = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_share_path = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_ssh_port = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.num_shell_tries = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.nvmet_port_id = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.replication_device = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.report_discard_supported = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.reserved_percentage = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.scst_target_driver = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.storage_protocol = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.target_helper = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.target_ip_address = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.target_port = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.target_prefix = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.target_protocol = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.trace_flags = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.use_chap_auth = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_clear = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_clear_size = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] QuobyteHD.volumes_dir = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.ssl = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_notifications.driver = [] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_notifications.retry = -1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] key_manager.fixed_key = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.barbican_api_version = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.barbican_endpoint = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.barbican_endpoint_type = public {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.barbican_region_name = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.cafile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.collect_timing = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.insecure = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.number_of_retries = 60 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.retry_delay = 1 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.send_service_user_token = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.split_loggers = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.verify_ssl = True {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican.verify_ssl_path = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.auth_section = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.auth_type = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.cafile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.certfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.collect_timing = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.insecure = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.keyfile = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.split_loggers = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] barbican_service_user.timeout = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.approle_role_id = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.approle_secret_id = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.kv_mountpoint = secret {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.kv_path = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.kv_version = 2 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.namespace = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.root_token_id = **** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.ssl_ca_crt_file = None {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.timeout = 60.0 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.use_ssl = False {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:35 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] ******************************************************************************** {{(pid=82223) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 17:30:35 devstack quobyte-client[82341]: Reading configuration file: /etc/quobyte/client.cfg Apr 09 17:30:35 devstack quobyte-client[82341]: Invalid parameters found, error: missing mount point. Apr 09 17:30:35 devstack quobyte-client[82341]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 09 17:30:35 devstack quobyte-client[82341]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:35 devstack cinder-volume[82337]: INFO cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 ... Apr 09 17:30:35 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac -c /etc/quobyte/client-cinder.cfg {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:35 devstack sudo[82342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac -c /etc/quobyte/client-cinder.cfg Apr 09 17:30:35 devstack sudo[82342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:36 devstack sudo[82342]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.587s {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:36 devstack cinder-volume[82337]: INFO cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 succeeded Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.612s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:36 devstack sudo[82426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:36 devstack sudo[82426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:36 devstack sudo[82426]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.419s {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:36 devstack cinder-volume[82337]: INFO cinder.volume.driver [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG cinder.volume.driver [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82337) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_db.sqlalchemy.engines [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG dbcounter [-] [82337] Writer thread running {{(pid=82337) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG cinder.db.sqlalchemy.api [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Building query based on filter {{(pid=82337) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG cinder.image.image_utils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82337) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 17:30:36 devstack cinder-volume[82337]: INFO cinder.keymgr.migration [None req-21a8f63a-3547-451a-9d3c-b423dfc7e0e0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:36 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:36 devstack sudo[82439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:36 devstack sudo[82439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:37 devstack sudo[82439]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.538s {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG cinder.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Notifying Schedulers of capabilities ... {{(pid=82337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:30:37 devstack cinder-volume[82337]: INFO cinder.volume.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Driver initialization completed successfully. Apr 09 17:30:37 devstack cinder-volume[82337]: INFO cinder.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Initiating service 3 cleanup Apr 09 17:30:37 devstack cinder-volume[82337]: INFO cinder.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Service 3 cleanup completed. Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG cinder.service [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Creating RPC server for service cinder-volume {{(pid=82337) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG cinder.service [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82337) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 17:30:37 devstack cinder-volume[82337]: INFO cinder.volume.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:37 devstack sudo[82475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:37 devstack sudo[82475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:37 devstack sudo[82475]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:37 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.388s {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:37 devstack cinder-volume[82337]: INFO cinder.volume.manager [None req-8533e3b8-a3f9-4b36-af12-22026a216b39 None None] Driver post RPC initialization completed successfully. Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:39 devstack sudo[82491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:39 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:39 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG oslo_concurrency.processutils [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.386s {{(pid=82337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:39 devstack cinder-volume[82337]: DEBUG cinder.manager [None req-9f5d4bb3-bb77-4c84-82cd-a700da960443 None None] Notifying Schedulers of capabilities ... {{(pid=82337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:30:40 devstack cinder-volume[82223]: INFO oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Caught SIGTERM, stopping children Apr 09 17:30:40 devstack cinder-volume[82223]: DEBUG oslo_concurrency.lockutils [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Acquiring lock "singleton_lock" {{(pid=82223) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:30:40 devstack cinder-volume[82223]: DEBUG oslo_concurrency.lockutils [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Acquired lock "singleton_lock" {{(pid=82223) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:30:40 devstack cinder-volume[82223]: DEBUG oslo_concurrency.lockutils [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Releasing lock "singleton_lock" {{(pid=82223) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:30:40 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Stop services. {{(pid=82223) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 09 17:30:40 devstack cinder-volume[82223]: DEBUG oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Killing children. {{(pid=82223) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 09 17:30:40 devstack cinder-volume[82223]: INFO oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Waiting on 1 children to exit Apr 09 17:30:41 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Acquiring lock "singleton_lock" {{(pid=82337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:30:41 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Acquired lock "singleton_lock" {{(pid=82337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:30:41 devstack cinder-volume[82337]: DEBUG oslo_concurrency.lockutils [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Releasing lock "singleton_lock" {{(pid=82337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:30:41 devstack cinder-volume[82337]: WARNING amqp [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 17:30:41 devstack cinder-volume[82337]: WARNING amqp [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 17:30:41 devstack cinder-volume[82223]: INFO oslo_service.backend._eventlet.service [None req-e1f92d0d-d060-4c02-b109-997281e06bc6 None None] Child 82337 exited with status 0 Apr 09 17:30:41 devstack cinder-volume[82562]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 17:30:41 devstack cinder-volume[82562]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 17:30:41 devstack cinder-volume[82562]: we strongly recommend against using it for new projects. Apr 09 17:30:41 devstack cinder-volume[82562]: If you are already using Eventlet, we recommend migrating to a different Apr 09 17:30:41 devstack cinder-volume[82562]: framework. For more detail see Apr 09 17:30:41 devstack cinder-volume[82562]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 17:30:41 devstack cinder-volume[82562]: import eventlet # noqa Apr 09 17:30:43 devstack cinder-volume[82562]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82562) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 17:30:43 devstack cinder-volume[82562]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82562) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 17:30:43 devstack cinder-volume[82562]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82562) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 17:30:43 devstack cinder-volume[82562]: INFO dbcounter [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Registered counter for database cinder Apr 09 17:30:43 devstack cinder-volume[82562]: DEBUG oslo_db.sqlalchemy.engines [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82562) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG dbcounter [-] [82562] Writer thread running {{(pid=82562) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 17:30:44 devstack cinder-volume[82562]: INFO cinder.rpc [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 17:30:44 devstack cinder-volume[82562]: INFO cinder.rpc [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_db.sqlalchemy.engines [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82562) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:44 devstack cinder-volume[82562]: INFO cinder.volume.manager [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Determined volume DB was empty at startup. Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG cinder.volume.manager [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82562) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 17:30:44 devstack cinder-volume[82562]: WARNING stevedore.named [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 17:30:44 devstack cinder-volume[82562]: WARNING castellan.key_manager [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:30:44 devstack cinder-volume[82562]: WARNING cinder.keymgr.conf_key_mgr [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 17:30:44 devstack cinder-volume[82562]: INFO cinder.volume.manager [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_db.sqlalchemy.engines [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82562) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:44 devstack cinder-volume[82562]: INFO oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Starting 1 workers Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Started child 82701 {{(pid=82562) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Full set of CONF: {{(pid=82562) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] ******************************************************************************** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Configuration options gathered from: {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] ================================================================================ {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] allow_availability_zone_fallback = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] allow_compression_on_image_upload = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] allowed_direct_url_schemes = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] api_rate_limit = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] auth_strategy = keystone {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_availability_zone = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_host = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_stats_polling_interval = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backup_api_class = cinder.backup.api.API {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backup_name_template = backup-%s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backup_use_same_host = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backup_use_temp_snapshot = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] chap_password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] chap_username = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_internal_tenant_project_id = d1cb03009696487299309ab35a3c9a0d {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_internal_tenant_user_id = af9c146dadf0481592779e98d6785a4c {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cluster = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] compression_format = gzip {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] compute_api_class = cinder.compute.nova.API {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] config_dir = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] config_source = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82701]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] control_exchange = openstack {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] debug = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] default_availability_zone = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] default_group_type = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] default_volume_type = QuobyteHD {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] disk_geometry = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] driver_client_cert = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] driver_client_cert_key = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] driver_data_namespace = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] driver_ssl_cert_path = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] driver_ssl_cert_verify = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] driver_use_ssl = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] enable_new_services = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] enable_unsupported_driver = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] enabled_backends = ['QuobyteHD'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] enforce_multipath_for_image_xfer = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] filter_function = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_api_insecure = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_api_ssl_compression = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_ca_certificates_file = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_catalog_info = image:glance:publicURL {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_num_retries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance_request_timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] goodness_function = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] graceful_shutdown_timeout = 5 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] group_api_class = cinder.group.api.API {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] host = devstack {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_compress_on_upload = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_conversion_address_space_limit = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_conversion_cpu_limit = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_conversion_disable = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_upload_use_cinder_backend = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_upload_use_internal_tenant = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_volume_cache_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_volume_cache_max_count = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] image_volume_cache_max_size_gb = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] init_host_max_objects_retrieval = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] instance_format = [instance: %(uuid)s] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] iscsi_target_flags = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] iscsi_write_cache = on {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] iser_helper = tgtadm {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] iser_ip_address = 192.168.122.149 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] iser_port = 3260 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_color = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_config_append = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_dir = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_file = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_options = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_rotate_interval = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_rotate_interval_type = days {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] log_rotation_type = none {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] max_age = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] max_logfile_count = 30 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] max_logfile_size_mb = 200 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] max_over_subscription_ratio = 20.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] message_reap_interval = 86400 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] message_ttl = 2592000 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] migration_create_volume_timeout_secs = 300 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] monkey_patch = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] monkey_patch_modules = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] my_ip = 192.168.122.149 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] no_snapshot_gb_quota = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] num_iser_scan_tries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] num_shell_tries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] num_volume_device_scan_tries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] nvmeof_conn_info_version = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] nvmet_ns_id = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] nvmet_port_id = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_max_limit = 1000 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_volume_ext_list = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82701) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_volume_listen_port = 8776 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_volume_use_ssl = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] osapi_volume_workers = 2 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] per_volume_size_limit = -1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] periodic_fuzzy_delay = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] periodic_interval = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] public_endpoint = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] publish_errors = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_backup_gigabytes = 1000 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_backups = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_gigabytes = 1000 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_groups = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_snapshots = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] quota_volumes = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] rate_limit_burst = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] rate_limit_except_level = CRITICAL {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] rate_limit_interval = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] reinit_driver_count = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] replication_device = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] report_discard_supported = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] report_interval = 120 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] reservation_clean_interval = 86400 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] reservation_expire = 86400 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] reserved_image_namespaces = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] reserved_percentage = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] rpc_response_timeout = 120 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] run_external_periodic_tasks = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] scst_target_driver = iscsi {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] scst_target_iqn_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_down_time = 720 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] shell_completion = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] snapshot_name_template = snapshot-%s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] split_loggers = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] state_path = /opt/stack/data/cinder {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] storage_availability_zone = nova {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] storage_protocol = iSCSI {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] syslog_log_facility = LOG_USER {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] target_helper = lioadm {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] target_ip_address = 192.168.122.149 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] target_port = 3260 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] target_protocol = iscsi {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] target_secondary_ip_addresses = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] trace_flags = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] transport_url = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] until_refresh = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_chap_auth = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_default_quota_class = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_journal = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_json = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_multipath_for_image_xfer = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_stderr = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] use_syslog = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] verify_glance_signatures = enabled {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_api_class = cinder.volume.api.API {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_backend_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_clear = zero {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_clear_ionice = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_clear_size = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_copy_bps_limit = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_dd_blocksize = 1M {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_name_template = volume-%s {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_service_inithost_offload = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volume_usage_audit_period = month {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] zoning_mode = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_concurrency.disable_process_locking = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.admin_password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.admin_token = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.admin_user = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_port = 35357 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_protocol = https {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_section = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_type = password {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_uri = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.auth_version = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.cache = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.identity_uri = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.include_service_catalog = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.insecure = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.interface = public {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_password = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcache_username = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.region_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.service_type = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.backend = dogpile.cache.null {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.backend_argument = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.backend_expiration_time = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.config_prefix = cache.oslo {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.debug_cache_backend = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.enable_retry_client = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.enable_socket_keepalive = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.enforce_fips_mode = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.expiration_time = 600 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.hashclient_retry_attempts = 2 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_dead_retry = 300 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_pool_maxsize = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_sasl_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.proxies = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.redis_db = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.redis_server = localhost:6379 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.retry_attempts = 2 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.retry_delay = 0.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.socket_keepalive_count = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.socket_keepalive_idle = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.socket_keepalive_interval = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.socket_timeout = 1.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.tls_allowed_ciphers = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.tls_cafile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.tls_certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.tls_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.tls_keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cache.username = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] coordination.backend_url = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.asyncio_connection = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.asyncio_slave_connection = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.backend = sqlalchemy {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.connection = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.connection_debug = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.connection_parameters = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.connection_recycle_time = 3600 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.connection_trace = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.db_inc_retry_interval = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.db_max_retries = 20 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.db_max_retry_interval = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.db_retry_interval = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.max_overflow = 50 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.max_pool_size = 5 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.max_retries = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.mysql_wsrep_sync_wait = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.pool_timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82701) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 09 17:30:44 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 09 17:30:44 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Running cmd (subprocess): mount.quobyte {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.retry_interval = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.slave_connection = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.sqlite_synchronous = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.synchronous_reader = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] database.use_db_reconnect = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.connection_string = messaging:// {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.es_doc_type = notification {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.es_scroll_size = 10000 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.es_scroll_time = 2m {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.filter_error_trace = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.hmac_keys = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.sentinel_service_name = mymaster {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.socket_timeout = 0.1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.trace_requests = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler.trace_sqlalchemy = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler_jaeger.process_tags = {} {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler_jaeger.service_name_prefix = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] profiler_otlp.service_name_prefix = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.enforce_new_defaults = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: WARNING oslo_config.cfg [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.enforce_scope = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.policy_default_rule = default {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.policy_file = policy.yaml {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.group = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.helper_command = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] privsep_osbrick.user = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.group = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.helper_command = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] cinder_sys_admin.user = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.auth_section = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.auth_type = password {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.cafile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.collect_timing = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.insecure = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.send_service_user_token = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.split_loggers = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] service_user.timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.auth_section = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.auth_type = password {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.collect_timing = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.insecure = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.region_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.split_loggers = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] glance.timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.backend_availability_zone = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.chap_password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.chap_username = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.disk_geometry = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.driver_client_cert = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.driver_client_cert_key = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.driver_data_namespace = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.driver_use_ssl = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.extra_capabilities = {} {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.filter_function = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.goodness_function = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.iscsi_target_flags = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.iscsi_write_cache = on {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.iser_helper = tgtadm {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.iser_port = 3260 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_host = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_login = admin {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_mount_options = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_private_key = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_share_path = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.num_shell_tries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.quobyte_volume_url = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.replication_device = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.report_discard_supported = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.reserved_percentage = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.target_helper = tgtadm {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.target_port = 3260 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.target_protocol = iscsi {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.trace_flags = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.unique_fqdn_network = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.use_chap_auth = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_backend_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_clear = zero {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_clear_ionice = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_clear_size = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_reports.file_event_handler = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_reports.log_dir = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.backend_availability_zone = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.backend_host = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.chap_password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.chap_username = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.chiscsi_conf = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.disk_geometry = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.driver_client_cert = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.driver_data_namespace = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.driver_use_ssl = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.extra_capabilities = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.filter_function = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.goodness_function = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.iser_helper = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.iser_ip_address = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.iser_port = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.iser_target_prefix = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_host = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_login = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_mount_options = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_password = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_private_key = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_share_path = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_ssh_port = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.num_shell_tries = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.nvmet_port_id = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.replication_device = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.report_discard_supported = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.reserved_percentage = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.scst_target_driver = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.storage_protocol = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.target_helper = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.target_ip_address = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.target_port = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.target_prefix = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.target_protocol = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.trace_flags = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.use_chap_auth = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_clear = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_clear_size = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] QuobyteHD.volumes_dir = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack quobyte-client[82736]: Reading configuration file: /etc/quobyte/client.cfg Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack quobyte-client[82736]: Invalid parameters found, error: missing mount point. Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack quobyte-client[82736]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack quobyte-client[82736]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] CMD "mount.quobyte" returned: 1 in 0.188s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.ssl = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_notifications.driver = [] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_notifications.retry = -1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] key_manager.fixed_key = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.barbican_api_version = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.barbican_endpoint = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.barbican_endpoint_type = public {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.barbican_region_name = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.cafile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.collect_timing = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.insecure = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.number_of_retries = 60 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.retry_delay = 1 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.send_service_user_token = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.split_loggers = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack sudo[82769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.verify_ssl = True {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican.verify_ssl_path = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.auth_section = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.auth_type = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.cafile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.certfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.collect_timing = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack sudo[82769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.insecure = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.keyfile = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.split_loggers = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] barbican_service_user.timeout = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.approle_role_id = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.approle_secret_id = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.kv_mountpoint = secret {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.kv_path = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.kv_version = 2 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.namespace = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.root_token_id = **** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.ssl_ca_crt_file = None {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.timeout = 60.0 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.use_ssl = False {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 17:30:44 devstack cinder-volume[82562]: DEBUG oslo_service.backend._eventlet.service [None req-72bb596e-e003-432d-8564-b807a69bdde8 None None] ******************************************************************************** {{(pid=82562) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:45 devstack sudo[82769]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:45 devstack cinder-volume[82701]: INFO cinder.volume.driver [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.volume.driver [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82701) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_db.sqlalchemy.engines [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writer thread running {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.db.sqlalchemy.api [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Building query based on filter {{(pid=82701) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82701) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:45 devstack cinder-volume[82701]: INFO cinder.keymgr.migration [None req-a5a27c85-90b2-49e2-80b0-77e02723b353 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 17:30:45 devstack sudo[82794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:45 devstack sudo[82794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:45 devstack sudo[82794]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.382s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:30:45 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Driver initialization completed successfully. Apr 09 17:30:45 devstack cinder-volume[82701]: INFO cinder.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Initiating service 3 cleanup Apr 09 17:30:45 devstack cinder-volume[82701]: INFO cinder.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Service 3 cleanup completed. Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.service [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Creating RPC server for service cinder-volume {{(pid=82701) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.service [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82701) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 17:30:45 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:30:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:30:45 devstack sudo[82806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:30:45 devstack sudo[82806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:30:46 devstack sudo[82806]: pam_unix(sudo:session): session closed for user root Apr 09 17:30:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:30:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-57c4abb8-153d-4e8d-9665-977a99f2fe72 None None] Driver post RPC initialization completed successfully. Apr 09 17:30:54 devstack cinder-volume[82562]: DEBUG dbcounter [-] [82562] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82562) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:30:55 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=4 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:30:56 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Flow 'volume_create_manager' (99611d60-f101-44cb-864f-1ce8d67b9f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd23f027-38bf-4223-a315-cd51b564bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd23f027-38bf-4223-a315-cd51b564bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2088647051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bd143b-94f6-4fb6-8c36-1368fd7bd737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2874e82f56b3437ca1662c9ededde44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:31:45Z,use_quota=True,user_id='91063d8a6d0f406d9083f3fae75cabe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6799b5c8-feab-47c5-9b52-6023fbc2b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6799b5c8-feab-47c5-9b52-6023fbc2b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d515a0cb-f2ce-417b-b250-99b54cd28217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d515a0cb-f2ce-417b-b250-99b54cd28217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bd143b-94f6-4fb6-8c36-1368fd7bd737', 'volume_name': 'volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae611391-fb24-4686-903b-bbfd8b5d33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae611391-fb24-4686-903b-bbfd8b5d33e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5434f5c-2b85-4592-a49e-048212775e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:44 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Volume 84bd143b-94f6-4fb6-8c36-1368fd7bd737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737', 'volume_size': 1} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2088647051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bd143b-94f6-4fb6-8c36-1368fd7bd737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2874e82f56b3437ca1662c9ededde44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:31:45Z,use_quota=True,user_id='91063d8a6d0f406d9083f3fae75cabe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Creating volume 84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:31:44 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:31:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:44 devstack sudo[83292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 1073741824 Apr 09 17:31:44 devstack sudo[83292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:45 devstack sudo[83292]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 1073741824" returned: 0 in 0.654s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:45 devstack sudo[83612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 Apr 09 17:31:45 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Flow 'volume_create_manager' (6d653dde-081c-4678-b4f3-b68fb465b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8e712f-69b2-4988-94f5-d6485552b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8e712f-69b2-4988-94f5-d6485552b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-545668625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204f86c3-a643-4613-bfa4-772e00afa0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df6a5f63529446fb8a01dbcfa51db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:31:45Z,use_quota=True,user_id='a572c4f1c7244631a95cc3fcb5bb6349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edadf83c-3b3f-4916-8d4a-cb62e74962fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edadf83c-3b3f-4916-8d4a-cb62e74962fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd977c3-d900-4367-9769-642dde7e85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd977c3-d900-4367-9769-642dde7e85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204f86c3-a643-4613-bfa4-772e00afa0fc', 'volume_name': 'volume-204f86c3-a643-4613-bfa4-772e00afa0fc', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e804231b-ca94-453a-8a2e-99f545640ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e804231b-ca94-453a-8a2e-99f545640ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6817de1-666e-4775-80bd-831ce4d2d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:45 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Volume 204f86c3-a643-4613-bfa4-772e00afa0fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204f86c3-a643-4613-bfa4-772e00afa0fc', 'volume_size': 1} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:45 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737" returned: 0 in 0.483s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-545668625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204f86c3-a643-4613-bfa4-772e00afa0fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df6a5f63529446fb8a01dbcfa51db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:31:45Z,use_quota=True,user_id='a572c4f1c7244631a95cc3fcb5bb6349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Creating volume 204f86c3-a643-4613-bfa4-772e00afa0fc {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:31:45 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5434f5c-2b85-4592-a49e-048212775e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2b6f81-f962-491d-9d15-a158d7a4cf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:45 devstack sudo[83615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc 1073741824 Apr 09 17:31:45 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:45 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Volume volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 (84bd143b-94f6-4fb6-8c36-1368fd7bd737): created successfully Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2b6f81-f962-491d-9d15-a158d7a4cf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Flow 'volume_create_manager' (99611d60-f101-44cb-864f-1ce8d67b9f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:31:45 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-89d4a696-fa40-4e67-865a-557de5790b05 req-6fd1184c-9f61-4413-8ed6-f528c54fa8e4 tempest-VolumesSnapshotsTestJSON-2043832404 None] Created volume successfully. Apr 09 17:31:46 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc 1073741824" returned: 0 in 0.467s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:46 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc Apr 09 17:31:46 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:46 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc" returned: 0 in 0.491s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6817de1-666e-4775-80bd-831ce4d2d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204f86c3-a643-4613-bfa4-772e00afa0fc', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764fdbe3-466a-47f8-9f1b-f408b5d7e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Creating offline snapshot 518e22e7-0121-43a6-854a-6b6bf3c9c609 of volume 84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:31:46 devstack cinder-volume[82701]: INFO oslo.privsep.daemon [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgw51bpqr/privsep.sock'] Apr 09 17:31:46 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Volume volume-204f86c3-a643-4613-bfa4-772e00afa0fc (204f86c3-a643-4613-bfa4-772e00afa0fc): created successfully Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764fdbe3-466a-47f8-9f1b-f408b5d7e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:31:46 devstack sudo[83624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgw51bpqr/privsep.sock Apr 09 17:31:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Flow 'volume_create_manager' (6d653dde-081c-4678-b4f3-b68fb465b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:31:46 devstack sudo[83624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4fbb4e7c-d726-4065-b11a-c2533a17dfae tempest-VolumesAdminNegativeTest-659603038 None] Created volume successfully. Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 17:31:47 devstack cinder-volume[82701]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 09 17:31:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Acquiring lock "cinder-204f86c3-a643-4613-bfa4-772e00afa0fc-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Lock "cinder-204f86c3-a643-4613-bfa4-772e00afa0fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Acquiring lock "cinder-quobyte-204f86c3-a643-4613-bfa4-772e00afa0fc" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Lock "cinder-quobyte-204f86c3-a643-4613-bfa4-772e00afa0fc" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:48 devstack sudo[83624]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:48 devstack cinder-volume[82701]: INFO oslo.privsep.daemon [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Spawned new privsep daemon via rootwrap Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Accepted privsep connection to /tmp/tmpgw51bpqr/privsep.sock {{(pid=82701) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 09 17:31:48 devstack cinder-volume[82701]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 09 17:31:48 devstack cinder-volume[82701]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 09 17:31:48 devstack cinder-volume[82701]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 09 17:31:48 devstack cinder-volume[82701]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83627 Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4adec1-d6f8-4058-9199-3759fa6c95b3]: (2,) {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:31:48 devstack cinder-volume[82701]: WARNING oslo_privsep.priv_context [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] privsep daemon already running Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf36f8-de55-4a84-bdab-489ba163ce9c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1aa839-67fa-4a70-8cd2-bf484ff61cb5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:48 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc Apr 09 17:31:48 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:48 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 Apr 09 17:31:48 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:48 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc" returned: 0 in 0.457s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:48 devstack sudo[83640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc Apr 09 17:31:48 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:48 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737" returned: 0 in 0.475s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:48 devstack sudo[83642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 1G Apr 09 17:31:48 devstack sudo[83642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:48 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-204f86c3-a643-4613-bfa4-772e00afa0fc" returned: 0 in 0.433s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Lock "cinder-quobyte-204f86c3-a643-4613-bfa4-772e00afa0fc" released by "delete_volume" :: held 1.196s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:31:49 devstack cinder-volume[82701]: WARNING cinder.quota [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:31:49 devstack cinder-volume[82701]: WARNING cinder.quota [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Created reservations ['d5d51a82-5ecd-4a4a-916c-b927040e0bad', '09d3fe8e-91f7-45eb-a130-e85cb7ea7a37', '9e16fd99-1ecf-430c-9a05-f7c1df67bc3c', '0fd1edfc-eaae-4aee-9ad9-07200321c94f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:49 devstack sudo[83649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:31:49 devstack sudo[83649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:49 devstack sudo[83642]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 1G" returned: 0 in 0.627s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:49 devstack sudo[83651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 Apr 09 17:31:49 devstack sudo[83651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:49 devstack sudo[83651]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609" returned: 0 in 0.437s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:49 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 is being set with open permissions: ugo+rw Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:49 devstack sudo[83649]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:31:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Deleted volume successfully. Apr 09 17:31:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1c0d89d6-8562-4d28-a9f9-7c7010f9450c tempest-VolumesAdminNegativeTest-659603038 None] Lock "cinder-204f86c3-a643-4613-bfa4-772e00afa0fc-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:31:49 devstack sudo[83658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 Apr 09 17:31:49 devstack sudo[83658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:50 devstack sudo[83658]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:50 devstack sudo[83666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info Apr 09 17:31:50 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:51 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info" returned: 0 in 0.809s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:51 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info is being set with open permissions: ugo+rw Apr 09 17:31:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:51 devstack sudo[83677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info Apr 09 17:31:51 devstack sudo[83677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:51 devstack sudo[83677]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.info" returned: 0 in 0.610s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.790s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:51 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-a48804e3-a26f-4165-b2d4-69b58fe64724 req-b848c73b-9222-474b-902a-fb9d5a5670d3 tempest-VolumesSnapshotsTestJSON-2043832404 None] Create snapshot completed successfully Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "cinder-518e22e7-0121-43a6-854a-6b6bf3c9c609-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-518e22e7-0121-43a6-854a-6b6bf3c9c609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "cinder-quobyte-84bd143b-94f6-4fb6-8c36-1368fd7bd737" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-quobyte-84bd143b-94f6-4fb6-8c36-1368fd7bd737" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "cinder-quobyte-518e22e7-0121-43a6-854a-6b6bf3c9c609" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-quobyte-518e22e7-0121-43a6-854a-6b6bf3c9c609" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Deleting offline snapshot 518e22e7-0121-43a6-854a-6b6bf3c9c609 of volume 84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] snapshot_file for this snap is: volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9cbca-6fcb-4ee0-bb00-5cfbd849a2ec]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:31:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:52 devstack sudo[83709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 Apr 09 17:31:52 devstack sudo[83709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:53 devstack sudo[83709]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609" returned: 0 in 0.537s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:31:53 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba89b5c3-e435-401a-ac1e-da6ef78192c1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:31:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:53 devstack sudo[83715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 Apr 09 17:31:53 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:54 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737" returned: 0 in 0.607s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:54 devstack sudo[83722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 Apr 09 17:31:54 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:54 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609" returned: 0 in 0.780s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:54 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609 Apr 09 17:31:54 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:55 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737.518e22e7-0121-43a6-854a-6b6bf3c9c609" returned: 0 in 0.498s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-quobyte-518e22e7-0121-43a6-854a-6b6bf3c9c609" released by "_delete_snapshot" :: held 2.533s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-quobyte-84bd143b-94f6-4fb6-8c36-1368fd7bd737" released by "delete_snapshot" :: held 2.551s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:31:55 devstack cinder-volume[82701]: WARNING cinder.quota [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.quota [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Created reservations ['99688dc0-11fa-42b2-aa5a-32cb24bec403', 'ce0873c7-27d8-421b-88b5-e049780f43a1', '5eb414d1-2e96-4aa0-9f3c-c1cfb600dc19', '6360eb63-a805-4710-9576-12c8b0ce5939'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:31:55 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Delete snapshot completed successfully. Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-9dbf7b52-3cb6-474b-afbd-257cacd1d1b0 req-b139839e-abd9-48aa-8373-8bd36712453a tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-518e22e7-0121-43a6-854a-6b6bf3c9c609-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "cinder-84bd143b-94f6-4fb6-8c36-1368fd7bd737-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-84bd143b-94f6-4fb6-8c36-1368fd7bd737-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "cinder-quobyte-84bd143b-94f6-4fb6-8c36-1368fd7bd737" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:31:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-quobyte-84bd143b-94f6-4fb6-8c36-1368fd7bd737" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:31:56 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[663786d8-bc1a-408d-83e0-06f7ca94329c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:31:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:56 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 Apr 09 17:31:56 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:56 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737" returned: 0 in 0.555s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:56 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737 Apr 09 17:31:56 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:57 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-84bd143b-94f6-4fb6-8c36-1368fd7bd737" returned: 0 in 0.646s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-quobyte-84bd143b-94f6-4fb6-8c36-1368fd7bd737" released by "delete_volume" :: held 1.280s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG cinder.quota [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Created reservations ['635a1d92-c1be-4913-8cb3-43f5ebd42e41', '6a8f5e48-7d3a-49cf-b012-e1709347097f', 'c6aa4165-4070-4913-84be-2c93f7905037', 'cfd95183-4fbe-4a15-bcca-1206dc1b4d05'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:31:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:31:57 devstack sudo[83767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:31:57 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:31:58 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root Apr 09 17:31:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.652s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:31:58 devstack cinder-volume[82701]: DEBUG cinder.manager [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:31:58 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Deleted volume successfully. Apr 09 17:31:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-963d012a-638c-46c8-8c41-758b70b54ae2 req-181cf1df-c557-4c7c-8f7f-7e3baaf20193 tempest-VolumesSnapshotsTestJSON-2043832404 None] Lock "cinder-84bd143b-94f6-4fb6-8c36-1368fd7bd737-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Flow 'volume_create_manager' (4950e58b-9803-427d-8182-3e634251606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4fabbc-7de2-4165-a2f3-04fd4af35601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4fabbc-7de2-4165-a2f3-04fd4af35601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-727052990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b95a71-406a-484a-be2d-93fe083ccd35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6644595e69414f5b9733781f9cbfc357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:03Z,use_quota=True,user_id='358567de458e4e8abe598118159b4278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c3e0ea-b4ad-4401-b93f-50483edad902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c3e0ea-b4ad-4401-b93f-50483edad902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edef119-fb78-4877-aa0d-4565a68accf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edef119-fb78-4877-aa0d-4565a68accf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b95a71-406a-484a-be2d-93fe083ccd35', 'volume_name': 'volume-93b95a71-406a-484a-be2d-93fe083ccd35', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc643d1e-d9f3-4fa5-995c-883ca8e98166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc643d1e-d9f3-4fa5-995c-883ca8e98166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4e35f5-5956-4a4c-bbff-0931ecc9674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:02 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Volume 93b95a71-406a-484a-be2d-93fe083ccd35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b95a71-406a-484a-be2d-93fe083ccd35', 'volume_size': 1} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-727052990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b95a71-406a-484a-be2d-93fe083ccd35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6644595e69414f5b9733781f9cbfc357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:03Z,use_quota=True,user_id='358567de458e4e8abe598118159b4278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Creating volume 93b95a71-406a-484a-be2d-93fe083ccd35 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:02 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:02 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 1073741824 Apr 09 17:32:02 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:03 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 1073741824" returned: 0 in 0.928s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:03 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 Apr 09 17:32:03 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:04 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35" returned: 0 in 0.532s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4e35f5-5956-4a4c-bbff-0931ecc9674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b95a71-406a-484a-be2d-93fe083ccd35', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c92822-3cda-49c3-aa60-57a35447bd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Volume volume-93b95a71-406a-484a-be2d-93fe083ccd35 (93b95a71-406a-484a-be2d-93fe083ccd35): created successfully Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c92822-3cda-49c3-aa60-57a35447bd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Flow 'volume_create_manager' (4950e58b-9803-427d-8182-3e634251606e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-8cc27709-2547-433a-88a5-40159099be7c req-fd18ae57-7875-4cb2-bae5-996b085d5367 tempest-VolumesGetTestJSON-1452534729 None] Created volume successfully. Apr 09 17:32:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Acquiring lock "cinder-93b95a71-406a-484a-be2d-93fe083ccd35-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Lock "cinder-93b95a71-406a-484a-be2d-93fe083ccd35-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Acquiring lock "cinder-quobyte-93b95a71-406a-484a-be2d-93fe083ccd35" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Lock "cinder-quobyte-93b95a71-406a-484a-be2d-93fe083ccd35" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e003b-ce18-4568-b3e0-11d7eae206f0]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:05 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 Apr 09 17:32:05 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:06 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35" returned: 0 in 0.656s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:06 devstack sudo[83858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35 Apr 09 17:32:06 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:06 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-93b95a71-406a-484a-be2d-93fe083ccd35" returned: 0 in 0.631s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Lock "cinder-quobyte-93b95a71-406a-484a-be2d-93fe083ccd35" released by "delete_volume" :: held 1.392s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG cinder.quota [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Created reservations ['97ac5d7e-6ec5-4411-a3a2-324487d60a74', '7add8e14-7c1d-4de6-9fa3-6dc7ea99dcf4', 'ec8a8e3c-dd25-4baa-a6a8-7a8d4516235a', '1217cf3d-97db-438d-9e97-b5c8be12af80'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:06 devstack sudo[83863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:06 devstack sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:07 devstack sudo[83863]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:07 devstack cinder-volume[82701]: DEBUG cinder.manager [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:07 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Deleted volume successfully. Apr 09 17:32:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-4acb8bfd-450e-4c37-a7c5-1b640c134bdb req-f12c3d3b-9892-4e88-889c-32840ca076ef tempest-VolumesGetTestJSON-1452534729 None] Lock "cinder-93b95a71-406a-484a-be2d-93fe083ccd35-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:08 devstack sudo[83895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:08 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:09 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 1.169s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:09 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Flow 'volume_create_manager' (752f61ce-c269-4e76-b66f-07d051a9da78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5828cc2-0fb7-4a7c-af23-d41cf79b5e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5828cc2-0fb7-4a7c-af23-d41cf79b5e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:10Z,deleted=False,deleted_at=None,display_description='',display_name='adb60403-b520-4864-b3ce-2c2b73350e98-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987fbe20-e7d4-466d-ac54-1e83bf64df59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050518b5c8e34819915e662db8f5d64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:10Z,use_quota=True,user_id='c52d4c5acd03466e98e20557337f22cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb19b966-ca15-43cd-a3c3-4a491af1327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb19b966-ca15-43cd-a3c3-4a491af1327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739897a6-4114-42eb-a1f9-40804d678af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739897a6-4114-42eb-a1f9-40804d678af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987fbe20-e7d4-466d-ac54-1e83bf64df59', 'volume_name': 'volume-987fbe20-e7d4-466d-ac54-1e83bf64df59', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5da604-fd4c-4121-b300-90d65c012ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5da604-fd4c-4121-b300-90d65c012ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eef1ace-e92f-4faf-8512-e54514389fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Volume 987fbe20-e7d4-466d-ac54-1e83bf64df59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987fbe20-e7d4-466d-ac54-1e83bf64df59', 'volume_size': 1} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:10Z,deleted=False,deleted_at=None,display_description='',display_name='adb60403-b520-4864-b3ce-2c2b73350e98-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987fbe20-e7d4-466d-ac54-1e83bf64df59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050518b5c8e34819915e662db8f5d64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:10Z,use_quota=True,user_id='c52d4c5acd03466e98e20557337f22cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Creating volume 987fbe20-e7d4-466d-ac54-1e83bf64df59 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:10 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:10 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 1073741824 Apr 09 17:32:10 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:12 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 1073741824" returned: 0 in 1.781s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:12 devstack sudo[83911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 Apr 09 17:32:12 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:13 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59" returned: 0 in 0.796s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] <== create_volume: return (2657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.659s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eef1ace-e92f-4faf-8512-e54514389fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987fbe20-e7d4-466d-ac54-1e83bf64df59', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c870fa90-2f17-4a65-a046-621a3513be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:13 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Volume volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 (987fbe20-e7d4-466d-ac54-1e83bf64df59): created successfully Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c870fa90-2f17-4a65-a046-621a3513be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Flow 'volume_create_manager' (752f61ce-c269-4e76-b66f-07d051a9da78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-8cac790f-6084-4b1d-b128-c61fd59a3bc7 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Created volume successfully. Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Flow 'volume_create_manager' (be7673bd-4e12-473f-b8e5-fbc6872df018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6897f-1a31-4e2c-965c-121184060842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb6897f-1a31-4e2c-965c-121184060842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-314097791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d4a0b7-791a-426d-9466-99e366105da9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5843b43aa6547c1a0a0c26f6e8cf4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:17Z,use_quota=True,user_id='5695b5c3ff634ca6b08a1a0d0db0e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991aa2b9-30e5-4637-a784-2c35a0935ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991aa2b9-30e5-4637-a784-2c35a0935ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625ae180-ffd2-46df-b656-43075734e01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625ae180-ffd2-46df-b656-43075734e01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d4a0b7-791a-426d-9466-99e366105da9', 'volume_name': 'volume-e1d4a0b7-791a-426d-9466-99e366105da9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9868f728-9958-49c0-830c-4a475d33e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9868f728-9958-49c0-830c-4a475d33e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d1f577-ff79-4356-8fa3-98a10ed9e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:16 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Volume e1d4a0b7-791a-426d-9466-99e366105da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d4a0b7-791a-426d-9466-99e366105da9', 'volume_size': 1} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-314097791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d4a0b7-791a-426d-9466-99e366105da9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5843b43aa6547c1a0a0c26f6e8cf4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:17Z,use_quota=True,user_id='5695b5c3ff634ca6b08a1a0d0db0e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Creating volume e1d4a0b7-791a-426d-9466-99e366105da9 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:16 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:17 devstack sudo[83969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 1073741824 Apr 09 17:32:17 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:17 devstack cinder-volume[82701]: WARNING py.warnings [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 09 17:32:17 devstack cinder-volume[82701]: .first() Apr 09 17:32:17 devstack cinder-volume[82701]: Apr 09 17:32:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:17 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 1073741824" returned: 0 in 0.981s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:17 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 Apr 09 17:32:17 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:18 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9" returned: 0 in 0.524s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.278s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d1f577-ff79-4356-8fa3-98a10ed9e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d4a0b7-791a-426d-9466-99e366105da9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68aba03b-bc4f-4393-bed6-eae2ab3a52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7070987-ea50-4fd1-8303-60d83491120a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:18 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Volume volume-e1d4a0b7-791a-426d-9466-99e366105da9 (e1d4a0b7-791a-426d-9466-99e366105da9): created successfully Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68aba03b-bc4f-4393-bed6-eae2ab3a52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Flow 'volume_create_manager' (be7673bd-4e12-473f-b8e5-fbc6872df018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-543d6ee5-3914-4635-8568-7562db500f36 tempest-VolumesTestJSON-1027640761 None] Created volume successfully. Apr 09 17:32:18 devstack sudo[83986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 Apr 09 17:32:18 devstack sudo[83986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:19 devstack sudo[83986]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59" returned: 0 in 0.999s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.030s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6', 'name': 'volume-987fbe20-e7d4-466d-ac54-1e83bf64df59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ce4314f-254d-4df0-bd87-5528aa39432f', 'enforce_multipath': True} {{(pid=82701) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Flow 'volume_create_manager' (ba680694-fa5a-42d6-a0c0-25c818cc2ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d791c3-436f-4ca3-be80-c6c24ef1d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-0fd87ec8-5ba2-4f93-8f2c-d877c6dd5d60 req-64b11734-1b48-4184-808b-091297fa525c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] attachment_update completed successfully. Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d791c3-436f-4ca3-be80-c6c24ef1d404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-354519910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601b1f58-395f-4340-bfc6-12803dad9d33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5843b43aa6547c1a0a0c26f6e8cf4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:19Z,use_quota=True,user_id='5695b5c3ff634ca6b08a1a0d0db0e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d5c8dc-199a-4962-9ddf-b5b7444c8b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d5c8dc-199a-4962-9ddf-b5b7444c8b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1077ef5-da9b-409e-8a05-e9af464c7899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1077ef5-da9b-409e-8a05-e9af464c7899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601b1f58-395f-4340-bfc6-12803dad9d33', 'volume_name': 'volume-601b1f58-395f-4340-bfc6-12803dad9d33', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07784ad9-5008-4dd0-a528-f8e665eae70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07784ad9-5008-4dd0-a528-f8e665eae70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54fd7d6c-edfd-40c9-9f5f-986534b8b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:19 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Volume 601b1f58-395f-4340-bfc6-12803dad9d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601b1f58-395f-4340-bfc6-12803dad9d33', 'volume_size': 1} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-354519910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601b1f58-395f-4340-bfc6-12803dad9d33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5843b43aa6547c1a0a0c26f6e8cf4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:19Z,use_quota=True,user_id='5695b5c3ff634ca6b08a1a0d0db0e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Creating volume 601b1f58-395f-4340-bfc6-12803dad9d33 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:19 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:19 devstack sudo[84011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 1073741824 Apr 09 17:32:19 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:20 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 1073741824" returned: 0 in 0.933s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:20 devstack sudo[84016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 Apr 09 17:32:20 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:21 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33" returned: 0 in 0.537s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54fd7d6c-edfd-40c9-9f5f-986534b8b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601b1f58-395f-4340-bfc6-12803dad9d33', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1f54f6-4cea-49bc-ac6d-b5a6863c8542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:21 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Volume volume-601b1f58-395f-4340-bfc6-12803dad9d33 (601b1f58-395f-4340-bfc6-12803dad9d33): created successfully Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1f54f6-4cea-49bc-ac6d-b5a6863c8542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Flow 'volume_create_manager' (ba680694-fa5a-42d6-a0c0-25c818cc2ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:21 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3852284d-ae94-46c8-9649-de4f75e3ba2a tempest-VolumesTestJSON-1027640761 None] Created volume successfully. Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Flow 'volume_create_manager' (135bf8be-4e6e-4e69-b4fc-be4d6f99a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168358ca-ce1e-4c92-a3b6-146dc7358913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168358ca-ce1e-4c92-a3b6-146dc7358913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-723072076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6283179-fa07-43b5-8971-cf7df334057d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7534d39ef63b41ca8f78656e613175e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:22Z,use_quota=True,user_id='4f2584edcb9d45a5949d0433023d6ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf65241-b866-4869-83ef-0c4e6abd9757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf65241-b866-4869-83ef-0c4e6abd9757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458d36cd-0187-47c4-88c8-4c540e447193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458d36cd-0187-47c4-88c8-4c540e447193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6283179-fa07-43b5-8971-cf7df334057d', 'volume_name': 'volume-a6283179-fa07-43b5-8971-cf7df334057d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5200900-d09c-4bca-a5a0-fee02b77a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5200900-d09c-4bca-a5a0-fee02b77a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee7471a-441d-4ab6-9513-035241a05518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:21 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Volume a6283179-fa07-43b5-8971-cf7df334057d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6283179-fa07-43b5-8971-cf7df334057d', 'volume_size': 1} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-723072076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6283179-fa07-43b5-8971-cf7df334057d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7534d39ef63b41ca8f78656e613175e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:22Z,use_quota=True,user_id='4f2584edcb9d45a5949d0433023d6ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Creating volume a6283179-fa07-43b5-8971-cf7df334057d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:21 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:21 devstack sudo[84019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d 1073741824 Apr 09 17:32:21 devstack sudo[84019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Flow 'volume_create_manager' (5cb383ba-0435-4996-864d-37023fcb8cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eef7cd-90c3-4f77-b6bd-6145c9085c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eef7cd-90c3-4f77-b6bd-6145c9085c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1967447689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82c853a-563c-4e24-b67b-6966f7c5ee1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5843b43aa6547c1a0a0c26f6e8cf4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:22Z,use_quota=True,user_id='5695b5c3ff634ca6b08a1a0d0db0e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ab7751-a674-4c66-b264-34e87ead008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ab7751-a674-4c66-b264-34e87ead008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9eebc37-ca72-4534-9da4-25bfa54bde99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9eebc37-ca72-4534-9da4-25bfa54bde99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82c853a-563c-4e24-b67b-6966f7c5ee1b', 'volume_name': 'volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e4311c-4e01-4e49-ae21-db71232deb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e4311c-4e01-4e49-ae21-db71232deb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49508c93-ca6b-4c19-b008-750445de8300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:22 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Volume a82c853a-563c-4e24-b67b-6966f7c5ee1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b', 'volume_size': 1} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:22 devstack sudo[84019]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d 1073741824" returned: 0 in 1.127s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:22 devstack sudo[84092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d Apr 09 17:32:22 devstack sudo[84092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:23 devstack sudo[84092]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d" returned: 0 in 0.570s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1967447689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82c853a-563c-4e24-b67b-6966f7c5ee1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5843b43aa6547c1a0a0c26f6e8cf4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:22Z,use_quota=True,user_id='5695b5c3ff634ca6b08a1a0d0db0e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Creating volume a82c853a-563c-4e24-b67b-6966f7c5ee1b {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:23 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee7471a-441d-4ab6-9513-035241a05518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6283179-fa07-43b5-8971-cf7df334057d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacecb81-a02b-415a-937d-3db8c91e93c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:23 devstack sudo[84095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b 1073741824 Apr 09 17:32:23 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:23 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Volume volume-a6283179-fa07-43b5-8971-cf7df334057d (a6283179-fa07-43b5-8971-cf7df334057d): created successfully Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacecb81-a02b-415a-937d-3db8c91e93c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Flow 'volume_create_manager' (135bf8be-4e6e-4e69-b4fc-be4d6f99a40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e7a0f514-f03e-42da-a10d-d80bc3224220 tempest-ServersNegativeTestJSON-691661454 None] Created volume successfully. Apr 09 17:32:25 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b 1073741824" returned: 0 in 1.606s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:25 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b Apr 09 17:32:25 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:26 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b" returned: 0 in 1.249s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] <== create_volume: return (2902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.906s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49508c93-ca6b-4c19-b008-750445de8300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a731154-126c-4d1e-b101-34a66786bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Volume volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b (a82c853a-563c-4e24-b67b-6966f7c5ee1b): created successfully Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a731154-126c-4d1e-b101-34a66786bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Flow 'volume_create_manager' (5cb383ba-0435-4996-864d-37023fcb8cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Flow 'volume_create_manager' (c832d146-951e-49c6-9968-1f23f5df8c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135865cd-86bc-4e14-9c7f-de27bdb805fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135865cd-86bc-4e14-9c7f-de27bdb805fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-193740814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c911753-fe37-468c-9289-ab13a9f7bcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7534d39ef63b41ca8f78656e613175e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:26Z,use_quota=True,user_id='4f2584edcb9d45a5949d0433023d6ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b231d5-06f8-4743-b675-965e2657cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b231d5-06f8-4743-b675-965e2657cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160974c5-fd15-4a7a-926d-ae0109a92e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160974c5-fd15-4a7a-926d-ae0109a92e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c911753-fe37-468c-9289-ab13a9f7bcdf', 'volume_name': 'volume-1c911753-fe37-468c-9289-ab13a9f7bcdf', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668da7f-4bc8-4f16-b3c5-8dbadfdf63d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668da7f-4bc8-4f16-b3c5-8dbadfdf63d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425547c3-602a-4860-994c-1ab8cfde554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Volume 1c911753-fe37-468c-9289-ab13a9f7bcdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c911753-fe37-468c-9289-ab13a9f7bcdf', 'volume_size': 1} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-193740814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c911753-fe37-468c-9289-ab13a9f7bcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7534d39ef63b41ca8f78656e613175e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:26Z,use_quota=True,user_id='4f2584edcb9d45a5949d0433023d6ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Creating volume 1c911753-fe37-468c-9289-ab13a9f7bcdf {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:26 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3472f331-960c-49fe-826e-c6e479b5ae1a tempest-VolumesTestJSON-1027640761 None] Created volume successfully. Apr 09 17:32:26 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf 1073741824 Apr 09 17:32:26 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:27 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf 1073741824" returned: 0 in 1.140s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:27 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf Apr 09 17:32:27 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:28 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Acquiring lock "cinder-a82c853a-563c-4e24-b67b-6966f7c5ee1b-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf" returned: 0 in 0.693s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Lock "cinder-a82c853a-563c-4e24-b67b-6966f7c5ee1b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425547c3-602a-4860-994c-1ab8cfde554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c911753-fe37-468c-9289-ab13a9f7bcdf', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47eded5-4d9b-4186-984c-b0e171cda43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:28 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Volume volume-1c911753-fe37-468c-9289-ab13a9f7bcdf (1c911753-fe37-468c-9289-ab13a9f7bcdf): created successfully Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47eded5-4d9b-4186-984c-b0e171cda43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Flow 'volume_create_manager' (c832d146-951e-49c6-9968-1f23f5df8c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:28 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-25a47796-4928-4718-b1bd-9d8c637e6ce5 tempest-ServersNegativeTestJSON-691661454 None] Created volume successfully. Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Acquiring lock "cinder-quobyte-a82c853a-563c-4e24-b67b-6966f7c5ee1b" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Lock "cinder-quobyte-a82c853a-563c-4e24-b67b-6966f7c5ee1b" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a51a1d-a2f2-4ded-b918-5dba806834da]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:28 devstack sudo[84453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b Apr 09 17:32:28 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:29 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b" returned: 0 in 0.756s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:29 devstack sudo[84460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b Apr 09 17:32:29 devstack sudo[84460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "cinder-1c911753-fe37-468c-9289-ab13a9f7bcdf-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-1c911753-fe37-468c-9289-ab13a9f7bcdf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "cinder-quobyte-1c911753-fe37-468c-9289-ab13a9f7bcdf" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-quobyte-1c911753-fe37-468c-9289-ab13a9f7bcdf" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8224be-8674-4c27-b9fa-b52b53d2f63c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:30 devstack sudo[84460]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a82c853a-563c-4e24-b67b-6966f7c5ee1b" returned: 0 in 0.554s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Lock "cinder-quobyte-a82c853a-563c-4e24-b67b-6966f7c5ee1b" released by "delete_volume" :: held 1.346s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:30 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf Apr 09 17:32:30 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Created reservations ['411d2d39-a0ce-41f6-a76d-4729538b2724', '28debea6-4179-406d-8ea1-c8e33ae7ef21', '9ecc6c9c-714b-434c-ada3-bfedd52d3a61', '0e0f32de-a14c-44ac-a850-ea7dccb2ff37'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:30 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:30 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:30 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf" returned: 0 in 0.602s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:30 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf Apr 09 17:32:30 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:30 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Deleted volume successfully. Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9830babd-04fb-4d37-a0f2-23691fdb3017 tempest-VolumesTestJSON-1027640761 None] Lock "cinder-a82c853a-563c-4e24-b67b-6966f7c5ee1b-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Acquiring lock "cinder-601b1f58-395f-4340-bfc6-12803dad9d33-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Lock "cinder-601b1f58-395f-4340-bfc6-12803dad9d33-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Acquiring lock "cinder-quobyte-601b1f58-395f-4340-bfc6-12803dad9d33" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Lock "cinder-quobyte-601b1f58-395f-4340-bfc6-12803dad9d33" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0331282f-a34b-42c7-9d5e-eac46a3f07af]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:30 devstack sudo[84481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 Apr 09 17:32:30 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:31 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1c911753-fe37-468c-9289-ab13a9f7bcdf" returned: 0 in 0.540s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-quobyte-1c911753-fe37-468c-9289-ab13a9f7bcdf" released by "delete_volume" :: held 1.170s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Created reservations ['aa9b890d-1e0f-417d-b9ee-28be00bf994c', '5ffb8859-3609-4db6-a629-6045ae001039', '3191205e-119d-4e15-8bb8-9855d70ce351', 'e3b5f0fc-8b58-488a-8421-55f58a51bc04'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:31 devstack sudo[84486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:31 devstack sudo[84486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:31 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33" returned: 0 in 0.523s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:31 devstack sudo[84491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33 Apr 09 17:32:31 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:31 devstack sudo[84486]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.568s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:31 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Deleted volume successfully. Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1dfa4e8-c98b-44af-996d-047b1cfc71d2 tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-1c911753-fe37-468c-9289-ab13a9f7bcdf-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:31 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-601b1f58-395f-4340-bfc6-12803dad9d33" returned: 0 in 0.510s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Lock "cinder-quobyte-601b1f58-395f-4340-bfc6-12803dad9d33" released by "delete_volume" :: held 1.054s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Created reservations ['aecf6db2-ba4f-40fa-9ccb-483c472acbf0', 'dfc8a296-fce7-45cb-ab77-e67fecdf21ab', 'b1fe88f2-5681-46c6-9f74-6828df27b918', '3144ba78-e712-40f8-be8a-dd439b31d999'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:31 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:31 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "cinder-a6283179-fa07-43b5-8971-cf7df334057d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-a6283179-fa07-43b5-8971-cf7df334057d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "cinder-quobyte-a6283179-fa07-43b5-8971-cf7df334057d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-quobyte-a6283179-fa07-43b5-8971-cf7df334057d" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b79b04-cbf7-4b2f-841b-552aa6ebfed1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:32 devstack sudo[84498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d Apr 09 17:32:32 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:32 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:32 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Deleted volume successfully. Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c2a813f-7fdf-479b-9910-7aa9636d0a1b tempest-VolumesTestJSON-1027640761 None] Lock "cinder-601b1f58-395f-4340-bfc6-12803dad9d33-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:32 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:32 devstack sudo[84504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d Apr 09 17:32:32 devstack sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Acquiring lock "cinder-e1d4a0b7-791a-426d-9466-99e366105da9-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Lock "cinder-e1d4a0b7-791a-426d-9466-99e366105da9-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Acquiring lock "cinder-quobyte-e1d4a0b7-791a-426d-9466-99e366105da9" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Lock "cinder-quobyte-e1d4a0b7-791a-426d-9466-99e366105da9" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cebcd7b-698c-4212-8ab2-90d319574758]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:33 devstack sudo[84504]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:33 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a6283179-fa07-43b5-8971-cf7df334057d" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:33 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-quobyte-a6283179-fa07-43b5-8971-cf7df334057d" released by "delete_volume" :: held 0.988s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Created reservations ['e6c71498-7c45-4b3d-ac8d-2fcd5a39ca86', 'e88f6f94-8d83-4e69-89dc-2a43dd78aacc', '2dc9fca9-6806-4774-a657-733bfa79130f', '00f7df69-486c-42e0-9025-81b9673756d2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:33 devstack sudo[84509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:33 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:33 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9" returned: 0 in 0.605s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:33 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.439s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Deleted volume successfully. Apr 09 17:32:33 devstack sudo[84515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9 Apr 09 17:32:33 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d98a19b5-ad33-4656-8b5e-c8f62800fb9d tempest-ServersNegativeTestJSON-691661454 None] Lock "cinder-a6283179-fa07-43b5-8971-cf7df334057d-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:34 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e1d4a0b7-791a-426d-9466-99e366105da9" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Lock "cinder-quobyte-e1d4a0b7-791a-426d-9466-99e366105da9" released by "delete_volume" :: held 1.063s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Created reservations ['42524520-f77c-4efa-a37a-3d38318ce12e', 'c336684c-d938-4d84-91f5-34e7bfd40c07', '6079ddad-ba74-4aef-bd33-0bf7c0705379', '69de05e5-eb9b-409f-9443-096a1da9e96d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:34 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:34 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:34 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:34 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Deleted volume successfully. Apr 09 17:32:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07fac4b0-01b3-4217-87d6-cca6f1722eab tempest-VolumesTestJSON-1027640761 None] Lock "cinder-e1d4a0b7-791a-426d-9466-99e366105da9-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:38 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:UPDATE=99,cinder:SELECT=74,cinder:INSERT=27,cinder:DELETE=10 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:32:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-afa7e20e-a8ae-4c5f-a4c1-75988fce0f7a tempest-GroupSnapshotsTest-2066517290 None] Group tempest-GroupSnapshotsTest-Group-1729908956: creating Apr 09 17:32:38 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=73,cinder:UPDATE=100,cinder:DELETE=8,cinder:INSERT=19 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:32:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-afa7e20e-a8ae-4c5f-a4c1-75988fce0f7a tempest-GroupSnapshotsTest-2066517290 None] Group tempest-GroupSnapshotsTest-Group-1729908956: created successfully Apr 09 17:32:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-afa7e20e-a8ae-4c5f-a4c1-75988fce0f7a tempest-GroupSnapshotsTest-2066517290 None] Create group completed successfully. Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (182e5d22-7ba1-4c51-b7e5-af734276a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0efb9d-2c77-4d97-88fd-69de49b9b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0efb9d-2c77-4d97-88fd-69de49b9b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609060297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82b4ad0d-53cf-4d02-b096-91ec5c2ab40a,host='devstack@QuobyteHD#QuobyteHD',id=abadbc21-0166-4f8b-8fd6-cf6e219cd3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:40Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3fb06a5-f96b-40db-aee2-e71d9aa57ca0),volume_type_id=b3fb06a5-f96b-40db-aee2-e71d9aa57ca0)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34334f5c-0866-4fb4-bba5-23ebe9dd06c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34334f5c-0866-4fb4-bba5-23ebe9dd06c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791a6be6-7399-49e9-ac77-befd5fa53014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791a6be6-7399-49e9-ac77-befd5fa53014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abadbc21-0166-4f8b-8fd6-cf6e219cd3f2', 'volume_name': 'volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21f8361-fe56-49fc-a815-02c8cb75fee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21f8361-fe56-49fc-a815-02c8cb75fee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591febda-2428-44a8-8a70-c428eda3aa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:39 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Volume abadbc21-0166-4f8b-8fd6-cf6e219cd3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2', 'volume_size': 1} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=82b4ad0d-53cf-4d02-b096-91ec5c2ab40a,created_at=2026-04-09T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609060297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82b4ad0d-53cf-4d02-b096-91ec5c2ab40a,host='devstack@QuobyteHD#QuobyteHD',id=abadbc21-0166-4f8b-8fd6-cf6e219cd3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:40Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3fb06a5-f96b-40db-aee2-e71d9aa57ca0),volume_type_id=b3fb06a5-f96b-40db-aee2-e71d9aa57ca0)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Creating volume abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:39 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:39 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 1073741824 Apr 09 17:32:39 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:40 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 1073741824" returned: 0 in 0.502s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:40 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:32:40 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:40 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.503s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591febda-2428-44a8-8a70-c428eda3aa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871613e5-aae2-4917-a70b-7d418ae53dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Volume volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 (abadbc21-0166-4f8b-8fd6-cf6e219cd3f2): created successfully Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871613e5-aae2-4917-a70b-7d418ae53dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (182e5d22-7ba1-4c51-b7e5-af734276a40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:40 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3249a3d5-6a98-4160-8c7e-fcc0c4604dce tempest-GroupSnapshotsTest-2066517290 None] Created volume successfully. Apr 09 17:32:42 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] GroupSnapshot 62d3a814-83ea-4653-ae3a-dc252d188db2: creating. Apr 09 17:32:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Group snapshot 62d3a814-83ea-4653-ae3a-dc252d188db2: creating. {{(pid=82701) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 17:32:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Creating offline snapshot 7848c957-78a3-4e52-b7c6-99f1ef68acef of volume abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:32:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b04c5e-f9d4-4057-82b3-e9113bf212d8]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:42 devstack sudo[84697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:32:42 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:43 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.572s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:43 devstack sudo[84726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef 1G Apr 09 17:32:43 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:43 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef 1G" returned: 0 in 0.693s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:43 devstack sudo[84734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef Apr 09 17:32:43 devstack sudo[84734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:44 devstack sudo[84734]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef" returned: 0 in 0.797s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:44 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:44 devstack sudo[84739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef Apr 09 17:32:44 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Flow 'volume_create_manager' (49d198ed-d31a-4859-80c2-1baf8b98c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56d094c-8686-49ee-90c0-8382e4075065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56d094c-8686-49ee-90c0-8382e4075065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1913968179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946d7edd-4eac-42be-9adf-e491a26ae311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fb033363c493699baa8c368f25319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:45Z,use_quota=True,user_id='21779828b1c445ae9f788549011649c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b939810e-ed9d-48cc-9122-bf7ec69d01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b939810e-ed9d-48cc-9122-bf7ec69d01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b607dee-e733-47e9-803b-c4e107edfb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b607dee-e733-47e9-803b-c4e107edfb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946d7edd-4eac-42be-9adf-e491a26ae311', 'volume_name': 'volume-946d7edd-4eac-42be-9adf-e491a26ae311', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7fafd8-a0a6-4169-8acd-c12416aa43b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7fafd8-a0a6-4169-8acd-c12416aa43b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebc6b74-69c0-46f6-aaef-4af65c6f1093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:44 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Volume 946d7edd-4eac-42be-9adf-e491a26ae311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946d7edd-4eac-42be-9adf-e491a26ae311', 'volume_size': 1} Apr 09 17:32:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:45 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef" returned: 0 in 0.550s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:45 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info Apr 09 17:32:45 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:45 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info" returned: 0 in 0.747s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:45 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:32:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:45 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info Apr 09 17:32:45 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:46 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.info" returned: 0 in 0.604s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.085s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1913968179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946d7edd-4eac-42be-9adf-e491a26ae311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75fb033363c493699baa8c368f25319',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:45Z,use_quota=True,user_id='21779828b1c445ae9f788549011649c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Creating volume 946d7edd-4eac-42be-9adf-e491a26ae311 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:46 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:46 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 1073741824 Apr 09 17:32:46 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8b92891a-ef23-49fe-89b5-c27cd2009aaa tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 62d3a814-83ea-4653-ae3a-dc252d188db2: created successfully Apr 09 17:32:47 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 1073741824" returned: 0 in 0.862s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:47 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 Apr 09 17:32:47 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:48 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311" returned: 0 in 0.752s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebc6b74-69c0-46f6-aaef-4af65c6f1093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946d7edd-4eac-42be-9adf-e491a26ae311', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d3fd49-f791-4705-89c1-e91171150543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:48 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Volume volume-946d7edd-4eac-42be-9adf-e491a26ae311 (946d7edd-4eac-42be-9adf-e491a26ae311): created successfully Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d3fd49-f791-4705-89c1-e91171150543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Flow 'volume_create_manager' (49d198ed-d31a-4859-80c2-1baf8b98c949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-47535a3b-eeb8-4e70-a637-b7130f0cacbb tempest-DeleteServersTestJSON-471462892 None] Created volume successfully. Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-7848c957-78a3-4e52-b7c6-99f1ef68acef-249176c2-9465-400c-9fce-4846c7292d18" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-7848c957-78a3-4e52-b7c6-99f1ef68acef-249176c2-9465-400c-9fce-4846c7292d18" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Creating volume 249176c2-9465-400c-9fce-4846c7292d18 from snapshot 7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-249176c2-9465-400c-9fce-4846c7292d18" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-249176c2-9465-400c-9fce-4846c7292d18" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] snapshot: 7848c957-78a3-4e52-b7c6-99f1ef68acef, volume: 249176c2-9465-400c-9fce-4846c7292d18, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[90768a6f-4499-480e-9d3f-be5c83f7489a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:49 devstack sudo[84827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef Apr 09 17:32:49 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c6e09381-4563-4f30-8e72-bac923baffbd tempest-BackendsCapabilitiesAdminTestsJSON-1438074357 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82701) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 09 17:32:49 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef" returned: 0 in 0.551s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cad92d-856d-40a3-aa5d-15dee2a6a5c1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:49 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:32:49 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-386f9298-3be4-492c-abc8-5318919443ca tempest-BackendsCapabilitiesAdminTestsJSON-1438074357 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82701) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 09 17:32:50 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.576s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:50 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:32:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:50 devstack sudo[84842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 Apr 09 17:32:50 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:53 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18" returned: 0 in 3.369s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:53 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe33e35d-ab39-45da-aa69-2f26e1a72923]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:53 devstack sudo[84881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:32:53 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:54 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.788s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2, size 1024.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:32:54 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Converted 1024.00 MB image at 303.86 MB/s Apr 09 17:32:54 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:54 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 Apr 09 17:32:54 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:54 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-249176c2-9465-400c-9fce-4846c7292d18" released by "_copy_volume_from_snapshot" :: held 5.787s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-7848c957-78a3-4e52-b7c6-99f1ef68acef-249176c2-9465-400c-9fce-4846c7292d18" released by "_create_volume_from_snapshot" :: held 5.814s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.825s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.530s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7713d-a4f9-47a8-80fc-05daa7df861f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:55 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-54706788-815d-4617-9da3-7c0bb22e7681 tempest-GroupSnapshotsTest-2066517290 None] Create group from source-snapshot-62d3a814-83ea-4653-ae3a-dc252d188db2 completed successfully. Apr 09 17:32:55 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 Apr 09 17:32:55 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-249176c2-9465-400c-9fce-4846c7292d18" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-249176c2-9465-400c-9fce-4846c7292d18" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da50c56-2c0c-470d-8304-681eb24eb47f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:55 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 Apr 09 17:32:55 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:56 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311" returned: 0 in 1.261s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.281s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6', 'name': 'volume-946d7edd-4eac-42be-9adf-e491a26ae311', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee602b86-4010-492f-8e9b-17d7ff49de66', 'enforce_multipath': True} {{(pid=82701) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 17:32:56 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-1e8d68fe-3f04-4671-adbc-7c8956cd26ff req-c6cfa639-4acd-47cb-964f-3edf4ecfdba5 tempest-DeleteServersTestJSON-471462892 None] attachment_update completed successfully. Apr 09 17:32:56 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-acff16bc-c289-4b4c-8a29-0d9ae0819fa2 tempest-GroupsTest-1180144327 None] Group tempest-Group1-1929007138: creating Apr 09 17:32:56 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-acff16bc-c289-4b4c-8a29-0d9ae0819fa2 tempest-GroupsTest-1180144327 None] Group tempest-Group1-1929007138: created successfully Apr 09 17:32:56 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:56 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-acff16bc-c289-4b4c-8a29-0d9ae0819fa2 tempest-GroupsTest-1180144327 None] Create group completed successfully. Apr 09 17:32:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18" returned: 0 in 0.814s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:56 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18 Apr 09 17:32:56 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:57 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-249176c2-9465-400c-9fce-4846c7292d18" returned: 0 in 0.546s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-249176c2-9465-400c-9fce-4846c7292d18" released by "delete_volume" :: held 1.433s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['4ec4e0d8-92e1-40df-b4d2-53ce4b722bb0'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:57 devstack cinder-volume[82701]: WARNING cinder.quota [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-59769952 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-59769952, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:32:57 devstack cinder-volume[82701]: WARNING cinder.quota [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-59769952 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-59769952, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['bf0f0706-87fc-4bb4-b1af-2425f8d4f355', '845e36dd-2049-412e-b16e-d57837a9106c', 'f6b5b688-ce3f-434f-ae52-d438af3f3f5e', 'd7ecc5ce-27f0-4485-8b02-a7443763d115'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:57 devstack sudo[84923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:32:57 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cdd5542f-6459-49fb-b6b5-bc33db6ec9fb tempest-GroupsTest-1180144327 None] Group tempest-Group2-869147229: creating Apr 09 17:32:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cdd5542f-6459-49fb-b6b5-bc33db6ec9fb tempest-GroupsTest-1180144327 None] Group tempest-Group2-869147229: created successfully Apr 09 17:32:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cdd5542f-6459-49fb-b6b5-bc33db6ec9fb tempest-GroupsTest-1180144327 None] Create group completed successfully. Apr 09 17:32:57 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:57 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:32:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0cfdba2e-5d9b-4793-b068-051c0209623c tempest-GroupSnapshotsTest-2066517290 None] Delete group completed successfully. Apr 09 17:32:58 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 62d3a814-83ea-4653-ae3a-dc252d188db2: deleting Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 62d3a814-83ea-4653-ae3a-dc252d188db2: deleting {{(pid=82701) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-7848c957-78a3-4e52-b7c6-99f1ef68acef" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-7848c957-78a3-4e52-b7c6-99f1ef68acef" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Deleting offline snapshot 7848c957-78a3-4e52-b7c6-99f1ef68acef of volume abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] snapshot_file for this snap is: volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d1fd1-56a1-4516-84c7-d021e53344e3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:58 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef Apr 09 17:32:58 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:58 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef" returned: 0 in 0.595s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca907ddd-e1cf-4f70-9987-425fb070de26]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:32:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:58 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:32:58 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Flow 'volume_create_manager' (1102dd70-9873-4b64-9c09-afc4a5a63753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e071d0-ee98-46f9-9626-94088d7d5699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e071d0-ee98-46f9-9626-94088d7d5699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-545208786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f48988b5-3e9e-418a-8201-02b2ea2c6cd1,host='devstack@QuobyteHD#QuobyteHD',id=b6fb12b9-ce3c-423f-b2aa-475d9ff15f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6c15025db2491fa8f28e3f06f23ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:59Z,use_quota=True,user_id='e36db18f73bc4c008de82fa68ae8fde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61e1a32d-fdcf-4ae7-90d9-946638d58b5f),volume_type_id=61e1a32d-fdcf-4ae7-90d9-946638d58b5f)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b72fb4-b34b-41c4-9b81-1fc082ab456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b72fb4-b34b-41c4-9b81-1fc082ab456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5644ff54-c875-4b37-b273-e425f81542f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5644ff54-c875-4b37-b273-e425f81542f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fb12b9-ce3c-423f-b2aa-475d9ff15f27', 'volume_name': 'volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b428285-8dd0-4261-844f-d95283874173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b428285-8dd0-4261-844f-d95283874173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e99657-2974-47cf-abf0-567b9a69f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:32:59 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Volume b6fb12b9-ce3c-423f-b2aa-475d9ff15f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27', 'volume_size': 1} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f48988b5-3e9e-418a-8201-02b2ea2c6cd1,created_at=2026-04-09T15:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-545208786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f48988b5-3e9e-418a-8201-02b2ea2c6cd1,host='devstack@QuobyteHD#QuobyteHD',id=b6fb12b9-ce3c-423f-b2aa-475d9ff15f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6c15025db2491fa8f28e3f06f23ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:32:59Z,use_quota=True,user_id='e36db18f73bc4c008de82fa68ae8fde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61e1a32d-fdcf-4ae7-90d9-946638d58b5f),volume_type_id=61e1a32d-fdcf-4ae7-90d9-946638d58b5f)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Creating volume b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:32:59 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:59 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 1073741824 Apr 09 17:32:59 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:59 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.570s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:59 devstack sudo[84938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef Apr 09 17:32:59 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:59 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef" returned: 0 in 0.552s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:59 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Apr 09 17:32:59 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 1073741824" returned: 0 in 0.729s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:32:59 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:32:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:32:59 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 Apr 09 17:32:59 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:00 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2.7848c957-78a3-4e52-b7c6-99f1ef68acef" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-7848c957-78a3-4e52-b7c6-99f1ef68acef" released by "_delete_snapshot" :: held 2.213s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" released by "delete_snapshot" :: held 2.231s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:00 devstack cinder-volume[82701]: WARNING cinder.quota [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-59769952 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-59769952, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['06e74c0e-9eaa-49da-9628-4aa269ac1926', '52c11296-3f8a-403e-95cf-50310be45d36', '96ae74d8-5204-47f1-a785-7c4f564bcd25', '5a047d42-3a63-43b1-a3af-0b7a21abac22'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:00 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e99657-2974-47cf-abf0-567b9a69f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107b1388-35e6-491a-95ef-9fdeb7c31f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:00 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Volume volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 (b6fb12b9-ce3c-423f-b2aa-475d9ff15f27): created successfully Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107b1388-35e6-491a-95ef-9fdeb7c31f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Flow 'volume_create_manager' (1102dd70-9873-4b64-9c09-afc4a5a63753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f0dcb650-5c6b-4791-a298-713984faa552 tempest-GroupsTest-1180144327 None] Created volume successfully. Apr 09 17:33:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2481599c-042c-481b-8825-fad58af85256 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 62d3a814-83ea-4653-ae3a-dc252d188db2: deleted successfully Apr 09 17:33:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:01 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee733a71-2260-47db-9e1e-95d762f8fc78]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:01 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:33:01 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Acquiring lock "cinder-quobyte-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Lock "cinder-quobyte-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c099ac0-2b15-47c9-a797-c267426c14c1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:02 devstack sudo[85006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 Apr 09 17:33:02 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:02 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.789s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:02 devstack sudo[85019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2 Apr 09 17:33:02 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:02 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27" returned: 0 in 0.777s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:02 devstack sudo[85027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27 Apr 09 17:33:02 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:03 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" returned: 0 in 0.530s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-abadbc21-0166-4f8b-8fd6-cf6e219cd3f2" released by "delete_volume" :: held 1.383s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['58b6f80b-7a36-4a42-b027-d03b6384e06f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:03 devstack cinder-volume[82701]: WARNING cinder.db.sqlalchemy.api [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-59769952'] Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['02617db0-9b67-4c75-bb9a-b89a1c1a501e', '40cb0f0e-53c1-404c-8210-f42c244f77ca', 'e9cfe66f-bf52-4e4d-8e5a-ba2436eb68c0', 'e230b2d2-49f5-4dbd-88b9-cc1f2a3a9c9f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:03 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:03 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:03 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27" returned: 0 in 0.678s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Lock "cinder-quobyte-b6fb12b9-ce3c-423f-b2aa-475d9ff15f27" released by "delete_volume" :: held 1.515s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Created reservations ['34ffb3b1-d0eb-4eda-8d28-dad6fd0303b3'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:03 devstack cinder-volume[82701]: WARNING cinder.quota [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-883625303 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-883625303, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:03 devstack cinder-volume[82701]: WARNING cinder.quota [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-883625303 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-883625303, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Created reservations ['d53f05cc-ee8f-4488-85b8-556c83b93df7', 'fec169f2-f8ec-403e-80a7-cf4e9d5d7aa6', '0e14018f-8aea-40f3-8bc0-3971f3074407', '41549940-37d7-4d49-b5bb-66c351efbcbb'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:03 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.700s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:03 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2230f2d9-59e0-495f-af68-9e7aabf949dd tempest-GroupSnapshotsTest-2066517290 None] Delete group completed successfully. Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:03 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:03 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c2dc7303-814d-4d90-aa9a-8d79b48e9246 tempest-GroupSnapshotsTest-2066517290 None] Group tempest-GroupSnapshotsTest-Group-1567476872: creating Apr 09 17:33:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c2dc7303-814d-4d90-aa9a-8d79b48e9246 tempest-GroupSnapshotsTest-2066517290 None] Group tempest-GroupSnapshotsTest-Group-1567476872: created successfully Apr 09 17:33:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c2dc7303-814d-4d90-aa9a-8d79b48e9246 tempest-GroupSnapshotsTest-2066517290 None] Create group completed successfully. Apr 09 17:33:04 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.586s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5da50d50-3a05-4784-990a-fcab29029ce5 tempest-GroupsTest-1180144327 None] Delete group completed successfully. Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Created reservations ['4c4c11c9-63bf-4e4b-ad76-6364ba5ed315'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:04 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:04 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-06fbe8a6-3aab-4f87-81ff-e30f00a085e5 req-c7328c09-360c-4910-a0bf-e0af009763e3 tempest-DeleteServersTestJSON-471462892 None] Terminate volume connection completed successfully. Apr 09 17:33:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-06fbe8a6-3aab-4f87-81ff-e30f00a085e5 req-c7328c09-360c-4910-a0bf-e0af009763e3 tempest-DeleteServersTestJSON-471462892 None] Deleting attachment ee602b86-4010-492f-8e9b-17d7ff49de66. {{(pid=82701) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 17:33:05 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.418s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2e5dc726-988c-4a9a-8e03-2d8de55ba249 tempest-GroupsTest-1180144327 None] Delete group completed successfully. Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (f237d24b-bd1f-41a1-b173-49c7f790ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924f733c-0971-42ed-b487-833646c541e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924f733c-0971-42ed-b487-833646c541e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667539163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c4704f4-5eca-4840-ad50-98bc7f8799c2,host='devstack@QuobyteHD#QuobyteHD',id=3200ef46-48c5-4e48-991a-297f33d2368e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:06Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(405241ec-7979-4b3c-ad10-51ab28646fd2),volume_type_id=405241ec-7979-4b3c-ad10-51ab28646fd2)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e165a1bc-7614-4f76-bb8d-81ca2e4dd702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e165a1bc-7614-4f76-bb8d-81ca2e4dd702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe32143d-59ae-429f-96a0-a496970c7b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe32143d-59ae-429f-96a0-a496970c7b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3200ef46-48c5-4e48-991a-297f33d2368e', 'volume_name': 'volume-3200ef46-48c5-4e48-991a-297f33d2368e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af27b2f-c0cc-4614-96d3-1db5239972a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af27b2f-c0cc-4614-96d3-1db5239972a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494b4f2b-80d4-4f69-8a40-d43e37038919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:05 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Volume 3200ef46-48c5-4e48-991a-297f33d2368e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3200ef46-48c5-4e48-991a-297f33d2368e', 'volume_size': 1} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c4704f4-5eca-4840-ad50-98bc7f8799c2,created_at=2026-04-09T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667539163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c4704f4-5eca-4840-ad50-98bc7f8799c2,host='devstack@QuobyteHD#QuobyteHD',id=3200ef46-48c5-4e48-991a-297f33d2368e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:06Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(405241ec-7979-4b3c-ad10-51ab28646fd2),volume_type_id=405241ec-7979-4b3c-ad10-51ab28646fd2)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Creating volume 3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:05 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:05 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e 1073741824 Apr 09 17:33:05 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b8e03a9c-e4e6-4080-8f55-03068cf93a4a tempest-GroupsTest-1180144327 None] Group tempest-GroupsTest-Group-1539577376: creating Apr 09 17:33:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b8e03a9c-e4e6-4080-8f55-03068cf93a4a tempest-GroupsTest-1180144327 None] Group tempest-GroupsTest-Group-1539577376: created successfully Apr 09 17:33:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b8e03a9c-e4e6-4080-8f55-03068cf93a4a tempest-GroupsTest-1180144327 None] Create group completed successfully. Apr 09 17:33:06 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e 1073741824" returned: 0 in 0.610s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:06 devstack sudo[85085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e Apr 09 17:33:06 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:06 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e" returned: 0 in 0.430s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494b4f2b-80d4-4f69-8a40-d43e37038919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3200ef46-48c5-4e48-991a-297f33d2368e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c8bb8d-3915-4cb5-a48c-758ef00e385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:06 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Volume volume-3200ef46-48c5-4e48-991a-297f33d2368e (3200ef46-48c5-4e48-991a-297f33d2368e): created successfully Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c8bb8d-3915-4cb5-a48c-758ef00e385d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (f237d24b-bd1f-41a1-b173-49c7f790ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:06 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8cef8529-46bd-4fbe-9d25-dc0338917bbc tempest-GroupSnapshotsTest-2066517290 None] Created volume successfully. Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Flow 'volume_create_manager' (91178ae5-bf5b-4f49-8036-0a6aef332066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295c4b86-3481-464e-822a-e8ccd1657662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295c4b86-3481-464e-822a-e8ccd1657662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487350345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db81c8-0934-4fe7-a103-f7324e3684d7,host='devstack@QuobyteHD#QuobyteHD',id=fc6e443b-c42d-425c-a2d4-f92d266892c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6c15025db2491fa8f28e3f06f23ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:07Z,use_quota=True,user_id='e36db18f73bc4c008de82fa68ae8fde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49feeb7d-efef-46e5-8d1a-e76f3d4961b7),volume_type_id=49feeb7d-efef-46e5-8d1a-e76f3d4961b7)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55212c90-6398-4b41-921b-ccd89cb594c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55212c90-6398-4b41-921b-ccd89cb594c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58437e8-b470-4213-8442-daf5dba82fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58437e8-b470-4213-8442-daf5dba82fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6e443b-c42d-425c-a2d4-f92d266892c0', 'volume_name': 'volume-fc6e443b-c42d-425c-a2d4-f92d266892c0', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a209c1-8b1b-48bc-9343-6f5bd88ba6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a209c1-8b1b-48bc-9343-6f5bd88ba6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43d698-b0ba-494a-98c0-59051c87f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:07 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Volume fc6e443b-c42d-425c-a2d4-f92d266892c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6e443b-c42d-425c-a2d4-f92d266892c0', 'volume_size': 1} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77db81c8-0934-4fe7-a103-f7324e3684d7,created_at=2026-04-09T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487350345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db81c8-0934-4fe7-a103-f7324e3684d7,host='devstack@QuobyteHD#QuobyteHD',id=fc6e443b-c42d-425c-a2d4-f92d266892c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6c15025db2491fa8f28e3f06f23ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:07Z,use_quota=True,user_id='e36db18f73bc4c008de82fa68ae8fde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49feeb7d-efef-46e5-8d1a-e76f3d4961b7),volume_type_id=49feeb7d-efef-46e5-8d1a-e76f3d4961b7)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Creating volume fc6e443b-c42d-425c-a2d4-f92d266892c0 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:07 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:07 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 1073741824 Apr 09 17:33:07 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:07 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 1073741824" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:07 devstack sudo[85118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 Apr 09 17:33:07 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:08 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (7667337b-2b36-4eca-be2f-2f9f106f376c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:08 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1e3ac8-9ace-422b-8e56-ad48bfd06a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1e3ac8-9ace-422b-8e56-ad48bfd06a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1157112021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c4704f4-5eca-4840-ad50-98bc7f8799c2,host='devstack@QuobyteHD#QuobyteHD',id=53381aaa-b011-425e-9334-d0b237dedf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:08Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(405241ec-7979-4b3c-ad10-51ab28646fd2),volume_type_id=405241ec-7979-4b3c-ad10-51ab28646fd2)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08974e6-e2a0-43c6-bc3c-83d51792b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08974e6-e2a0-43c6-bc3c-83d51792b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca1b73b-071f-4623-9e0b-6abbc8c817f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca1b73b-071f-4623-9e0b-6abbc8c817f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53381aaa-b011-425e-9334-d0b237dedf24', 'volume_name': 'volume-53381aaa-b011-425e-9334-d0b237dedf24', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9730b8d-775c-497b-ac44-4cfecfe50a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9730b8d-775c-497b-ac44-4cfecfe50a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca91d235-d53a-4b6b-a147-76f55e20c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:08 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Volume 53381aaa-b011-425e-9334-d0b237dedf24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53381aaa-b011-425e-9334-d0b237dedf24', 'volume_size': 1} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:08 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c4704f4-5eca-4840-ad50-98bc7f8799c2,created_at=2026-04-09T15:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1157112021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c4704f4-5eca-4840-ad50-98bc7f8799c2,host='devstack@QuobyteHD#QuobyteHD',id=53381aaa-b011-425e-9334-d0b237dedf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:08Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(405241ec-7979-4b3c-ad10-51ab28646fd2),volume_type_id=405241ec-7979-4b3c-ad10-51ab28646fd2)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Creating volume 53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:08 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43d698-b0ba-494a-98c0-59051c87f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6e443b-c42d-425c-a2d4-f92d266892c0', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a738288-726b-49e4-a02f-df4ed95ef4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:08 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 1073741824 Apr 09 17:33:08 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:08 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Volume volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 (fc6e443b-c42d-425c-a2d4-f92d266892c0): created successfully Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a738288-726b-49e4-a02f-df4ed95ef4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Flow 'volume_create_manager' (91178ae5-bf5b-4f49-8036-0a6aef332066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:08 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-396a0ddf-59c9-4c49-87e7-4468f454f133 tempest-GroupsTest-1180144327 None] Created volume successfully. Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Acquiring lock "cinder-946d7edd-4eac-42be-9adf-e491a26ae311-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Lock "cinder-946d7edd-4eac-42be-9adf-e491a26ae311-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Acquiring lock "cinder-quobyte-946d7edd-4eac-42be-9adf-e491a26ae311" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Lock "cinder-quobyte-946d7edd-4eac-42be-9adf-e491a26ae311" acquired by "delete_volume" :: waited 0.023s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7210a774-50dc-43d0-a1ec-7681458ab82a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:08 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.781s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:08 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 Apr 09 17:33:08 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:09 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 1073741824" returned: 0 in 0.722s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:09 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 Apr 09 17:33:09 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:09 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311" returned: 0 in 0.621s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:09 devstack sudo[85137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311 Apr 09 17:33:09 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:09 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24" returned: 0 in 0.723s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Flow 'volume_create_manager' (3a84a712-f185-45ab-8bed-654518e7f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4cd93b-5d1d-4e2e-9187-48fc2eae3127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca91d235-d53a-4b6b-a147-76f55e20c537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53381aaa-b011-425e-9334-d0b237dedf24', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17514780-36f5-4cd2-84b7-d0cb53b712a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4cd93b-5d1d-4e2e-9187-48fc2eae3127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318434290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db81c8-0934-4fe7-a103-f7324e3684d7,host='devstack@QuobyteHD#QuobyteHD',id=ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6c15025db2491fa8f28e3f06f23ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:10Z,use_quota=True,user_id='e36db18f73bc4c008de82fa68ae8fde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49feeb7d-efef-46e5-8d1a-e76f3d4961b7),volume_type_id=49feeb7d-efef-46e5-8d1a-e76f3d4961b7)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa2b40f-6df4-45da-8608-ceabdaa3e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa2b40f-6df4-45da-8608-ceabdaa3e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6989fe-b3ab-46de-8b23-a36d9ff2beed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6989fe-b3ab-46de-8b23-a36d9ff2beed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e', 'volume_name': 'volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fb5b09-aa28-411b-8753-c653552797be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fb5b09-aa28-411b-8753-c653552797be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566bf73d-4a9e-429c-abe8-d52ac1895830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Volume ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e', 'volume_size': 1} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77db81c8-0934-4fe7-a103-f7324e3684d7,created_at=2026-04-09T15:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318434290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77db81c8-0934-4fe7-a103-f7324e3684d7,host='devstack@QuobyteHD#QuobyteHD',id=ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6c15025db2491fa8f28e3f06f23ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:10Z,use_quota=True,user_id='e36db18f73bc4c008de82fa68ae8fde8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49feeb7d-efef-46e5-8d1a-e76f3d4961b7),volume_type_id=49feeb7d-efef-46e5-8d1a-e76f3d4961b7)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Creating volume ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:10 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Volume volume-53381aaa-b011-425e-9334-d0b237dedf24 (53381aaa-b011-425e-9334-d0b237dedf24): created successfully Apr 09 17:33:10 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17514780-36f5-4cd2-84b7-d0cb53b712a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (7667337b-2b36-4eca-be2f-2f9f106f376c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:10 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e 1073741824 Apr 09 17:33:10 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-946d7edd-4eac-42be-9adf-e491a26ae311" returned: 0 in 0.554s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c66e0fab-ee0e-47a3-a742-4840cd3495b6 tempest-GroupSnapshotsTest-2066517290 None] Created volume successfully. Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Lock "cinder-quobyte-946d7edd-4eac-42be-9adf-e491a26ae311" released by "delete_volume" :: held 1.218s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Created reservations ['82411c9f-a044-41f5-b0c4-b09770341c0a', 'a23a4200-46f5-49f7-9e15-e505646b0a23', '52f5028c-d9d4-4236-96fc-ae74f7deb3f0', '80c38af4-36f7-4735-b9dc-a161b03fb6d8'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:10 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:10 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-dd5207df-bf62-4f77-b5c4-54a8d2a888cb tempest-GroupSnapshotsTest-2066517290 None] Update group completed successfully. Apr 09 17:33:10 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e 1073741824" returned: 0 in 0.652s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:10 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e Apr 09 17:33:10 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:10 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.596s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Deleted volume successfully. Apr 09 17:33:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c68c53b3-2d42-400f-bd0a-a279a173b917 tempest-DeleteServersTestJSON-471462892 None] Lock "cinder-946d7edd-4eac-42be-9adf-e491a26ae311-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:11 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566bf73d-4a9e-429c-abe8-d52ac1895830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3aaef8-34c9-4729-be79-600e5a6764c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:11 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Volume volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e (ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e): created successfully Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3aaef8-34c9-4729-be79-600e5a6764c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Flow 'volume_create_manager' (3a84a712-f185-45ab-8bed-654518e7f483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-59e59ce2-5cf6-4d59-810c-724674bfc064 tempest-GroupsTest-1180144327 None] Created volume successfully. Apr 09 17:33:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-484a6bf4-4874-451c-8ced-9762b1ea36a5 tempest-GroupSnapshotsTest-2066517290 None] Update group completed successfully. Apr 09 17:33:12 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-63828327-4a42-4791-813a-f89e497d823c tempest-GroupsTest-1180144327 None] Update group completed successfully. Apr 09 17:33:12 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-45280854-d4b8-41ed-9533-25366afe6b6a tempest-GroupSnapshotsTest-2066517290 None] Update group completed successfully. Apr 09 17:33:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a9f640e3-d3d7-4ba2-980d-08d73114ef8f tempest-GroupsTest-1180144327 None] Update group completed successfully. Apr 09 17:33:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-11a992a2-475f-433a-98fb-115deca7d597 tempest-GroupSnapshotsTest-2066517290 None] Update group completed successfully. Apr 09 17:33:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Acquiring lock "cinder-quobyte-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Lock "cinder-quobyte-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e" acquired by "delete_volume" :: waited 0.024s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:14 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526f411-d857-43dc-918a-327c2c557196]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:15 devstack sudo[85160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e Apr 09 17:33:15 devstack sudo[85160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:15 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] GroupSnapshot 795fb4f0-0029-4665-a56a-5af94f2d1722: creating. Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Group snapshot 795fb4f0-0029-4665-a56a-5af94f2d1722: creating. {{(pid=82701) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Creating offline snapshot 40c7a427-36ff-4f31-b583-2b6506cff6bb of volume 53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe65dea0-c865-449b-97f6-7fa3688436a2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:15 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 Apr 09 17:33:15 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:15 devstack sudo[85160]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e" returned: 0 in 0.615s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:15 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e Apr 09 17:33:15 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:15 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24" returned: 0 in 0.569s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:15 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb 1G Apr 09 17:33:15 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:16 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e" returned: 0 in 1.000s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Lock "cinder-quobyte-ae5c3f05-fcb4-44c6-ad6d-7e420aa42f1e" released by "delete_volume" :: held 1.668s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Acquiring lock "cinder-quobyte-fc6e443b-c42d-425c-a2d4-f92d266892c0" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Lock "cinder-quobyte-fc6e443b-c42d-425c-a2d4-f92d266892c0" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[443544c8-b96e-45b7-b377-43d40e04d7eb]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:16 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb 1G" returned: 0 in 0.847s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53381aaa-b011-425e-9334-d0b237dedf24 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:16 devstack sudo[85179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53381aaa-b011-425e-9334-d0b237dedf24 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb Apr 09 17:33:16 devstack sudo[85179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:16 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 Apr 09 17:33:16 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:17 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0" returned: 0 in 0.810s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:17 devstack sudo[85188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0 Apr 09 17:33:17 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:17 devstack sudo[85179]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53381aaa-b011-425e-9334-d0b237dedf24 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb" returned: 0 in 1.091s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:17 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:17 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb Apr 09 17:33:17 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Flow 'volume_create_manager' (82d76f04-09d2-46ea-8087-ac2a8fcf7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97761e01-58a1-42ad-9fe7-3db9c07c1530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97761e01-58a1-42ad-9fe7-3db9c07c1530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b169f18-4218-4750-8681-393f814c3f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050518b5c8e34819915e662db8f5d64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:18Z,use_quota=True,user_id='c52d4c5acd03466e98e20557337f22cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f268578-ff48-4700-bce5-a94c658b3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f268578-ff48-4700-bce5-a94c658b3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd792993-0871-4d14-b019-32458194dadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.image.glance [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Creating Keystone auth plugin from conf {{(pid=82701) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 17:33:18 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb" returned: 0 in 0.575s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:18 devstack sudo[85213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info Apr 09 17:33:18 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:18 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc6e443b-c42d-425c-a2d4-f92d266892c0" returned: 0 in 1.120s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Lock "cinder-quobyte-fc6e443b-c42d-425c-a2d4-f92d266892c0" released by "delete_volume" :: held 1.959s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd792993-0871-4d14-b019-32458194dadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b169f18-4218-4750-8681-393f814c3f49', 'volume_name': 'volume-4b169f18-4218-4750-8681-393f814c3f49', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c287cac-89aa-4201-9eac-d989f9d699ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c287cac-89aa-4201-9eac-d989f9d699ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d515b9-509d-4772-9693-b41953efb098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:18 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Volume 4b169f18-4218-4750-8681-393f814c3f49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b169f18-4218-4750-8681-393f814c3f49', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Trying to clone 4b169f18-4218-4750-8681-393f814c3f49 from image e1c6f14c-6844-4aad-9551-57f242d39ddc at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]). {{(pid=82701) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Created reservations ['b3d05b53-290a-4851-a767-04994589bdce'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:18 devstack cinder-volume[82701]: WARNING cinder.quota [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-703375663 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-703375663, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:18 devstack cinder-volume[82701]: WARNING cinder.quota [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-703375663 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-703375663, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Created reservations ['4bba84a3-c0d8-4a65-b4f2-54b6f69fdb02', 'b633597b-9c86-4c16-869e-554ac6ddd64b', '57da87ea-b114-46bb-a3bd-302451e6cbbf', 'b93da9ba-23bb-4832-bb6b-760bda990131'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Created reservations ['15f75262-7a73-40c2-9f7d-f15d6207b695', '9e7210ad-0da6-4c25-a420-8643d89eea94', 'a5314788-b77e-4a57-b6c5-f786a16f5955', '3e5c3199-2ac5-4db6-bd79-887a6c0d3d95'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 17:33:18 devstack cinder-volume[82701]: INFO cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Image download 20.69 MB at 20.69 MB/s Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:19 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:19 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad47953-5424-4b04-b526-44e0116dc4f2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:19 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD Apr 09 17:33:19 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:19 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info" returned: 0 in 0.872s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:19 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:19 devstack sudo[85241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info Apr 09 17:33:19 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:19 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.821s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6e8e447b-c604-40d0-893e-c6671b690f97 tempest-GroupsTest-1180144327 None] Delete group completed successfully. Apr 09 17:33:19 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD" returned: 0 in 0.937s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:19 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc is fetched for user c52d4c5acd03466e98e20557337f22cb. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 17:33:20 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.info" returned: 0 in 0.793s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.815s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ca59f-e301-49d3-addc-fe2aabf82519]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Creating offline snapshot 668d3e4e-6f0c-4bab-a371-4c1083b908ef of volume 3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be51572-9880-43ec-af10-10af103f5c5f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:20 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD Apr 09 17:33:20 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:20 devstack sudo[85251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e Apr 09 17:33:20 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:20 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:20 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e" returned: 0 in 0.894s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:21 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef 1G Apr 09 17:33:21 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:21 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef 1G" returned: 0 in 0.666s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3200ef46-48c5-4e48-991a-297f33d2368e -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:21 devstack sudo[85265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3200ef46-48c5-4e48-991a-297f33d2368e -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef Apr 09 17:33:21 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Flow 'volume_create_manager' (99805c6d-dd7a-4912-be2a-3f404893196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242a7d1a-52a3-4e1f-aad2-4125957ed697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242a7d1a-52a3-4e1f-aad2-4125957ed697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1224630970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49f2169-0862-4097-883d-9d391a251ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94de464c96bd439f9ad4a41b099060c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:22Z,use_quota=True,user_id='aeb52425bf9a4892b35da3ff0e86037b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a816c697-e48e-4574-9acd-f2c418882f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a816c697-e48e-4574-9acd-f2c418882f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adda7fb-f81b-466d-8dc6-6ef119dd168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adda7fb-f81b-466d-8dc6-6ef119dd168f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49f2169-0862-4097-883d-9d391a251ab5', 'volume_name': 'volume-f49f2169-0862-4097-883d-9d391a251ab5', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea642b6-6091-41d1-84f9-9c72ca1ee804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea642b6-6091-41d1-84f9-9c72ca1ee804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f060ad-3a8d-47b2-8efe-42aa959e5dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:21 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Volume f49f2169-0862-4097-883d-9d391a251ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49f2169-0862-4097-883d-9d391a251ab5', 'volume_size': 1} Apr 09 17:33:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:22 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3200ef46-48c5-4e48-991a-297f33d2368e -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef" returned: 0 in 0.560s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:22 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:22 devstack sudo[85270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef Apr 09 17:33:22 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:22 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:22 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info Apr 09 17:33:22 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:23 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:23 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:23 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info Apr 09 17:33:23 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0c7f371f-8641-44c4-bb54-4c4289af3bde tempest-GroupsV314Test-505929731 None] Group tempest-GroupsV314Test-Group-551662169: creating Apr 09 17:33:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0c7f371f-8641-44c4-bb54-4c4289af3bde tempest-GroupsV314Test-505929731 None] Group tempest-GroupsV314Test-Group-551662169: created successfully Apr 09 17:33:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0c7f371f-8641-44c4-bb54-4c4289af3bde tempest-GroupsV314Test-505929731 None] Create group completed successfully. Apr 09 17:33:23 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.info" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.816s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b169f18-4218-4750-8681-393f814c3f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050518b5c8e34819915e662db8f5d64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:18Z,use_quota=True,user_id='c52d4c5acd03466e98e20557337f22cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Creating volume 4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:23 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:23 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 1073741824 Apr 09 17:33:23 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4cb75408-5cf9-4091-9cd3-2ae66862349c tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 795fb4f0-0029-4665-a56a-5af94f2d1722: created successfully Apr 09 17:33:24 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 1073741824" returned: 0 in 0.506s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:24 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:33:24 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:24 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 0 in 0.456s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.746s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1224630970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49f2169-0862-4097-883d-9d391a251ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94de464c96bd439f9ad4a41b099060c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:22Z,use_quota=True,user_id='aeb52425bf9a4892b35da3ff0e86037b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Creating volume f49f2169-0862-4097-883d-9d391a251ab5 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:24 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:24 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 795fb4f0-0029-4665-a56a-5af94f2d1722: deleting Apr 09 17:33:24 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 1073741824 Apr 09 17:33:24 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 795fb4f0-0029-4665-a56a-5af94f2d1722: deleting {{(pid=82701) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Attempting download of e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume 4b169f18-4218-4750-8681-393f814c3f49. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-53381aaa-b011-425e-9334-d0b237dedf24" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-53381aaa-b011-425e-9334-d0b237dedf24" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-40c7a427-36ff-4f31-b583-2b6506cff6bb" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ecf95-23f5-4788-ae91-dd45286fccbd]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-40c7a427-36ff-4f31-b583-2b6506cff6bb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Deleting offline snapshot 40c7a427-36ff-4f31-b583-2b6506cff6bb of volume 53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] snapshot_file for this snap is: volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01464817-0920-4c89-b77d-c40018423012]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:24 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb Apr 09 17:33:24 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:25 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea Apr 09 17:33:25 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Flow 'volume_create_manager' (c9ed8947-cf0a-441c-948a-b22b7a649f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3ff818-bcd9-4aeb-8192-09c56d3297b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3ff818-bcd9-4aeb-8192-09c56d3297b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648951032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05f2d687-57cc-4921-aa22-fc3b7d60897d,host='devstack@QuobyteHD#QuobyteHD',id=abeebd6d-97af-431b-b7fc-206d0039cf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d9eebbdf984537a38ea2266cf528e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:25Z,use_quota=True,user_id='db9344d1350346a8a1ad607ee0d9a1bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6b136b0-c76a-4b6e-ac36-9a716c4c946c),volume_type_id=f6b136b0-c76a-4b6e-ac36-9a716c4c946c)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46359c2-d892-4b70-99a8-269c47285ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46359c2-d892-4b70-99a8-269c47285ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ea9493-6dc8-44ff-aeef-30218a0b5f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ea9493-6dc8-44ff-aeef-30218a0b5f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abeebd6d-97af-431b-b7fc-206d0039cf61', 'volume_name': 'volume-abeebd6d-97af-431b-b7fc-206d0039cf61', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaa9119-b3b9-42ea-b126-f4324875aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaa9119-b3b9-42ea-b126-f4324875aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149d1008-c9f7-4f74-bf66-9a7867139e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Volume abeebd6d-97af-431b-b7fc-206d0039cf61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abeebd6d-97af-431b-b7fc-206d0039cf61', 'volume_size': 1} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:25 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 1073741824" returned: 0 in 0.644s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:25 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 Apr 09 17:33:25 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:25 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea" returned: 0 in 0.769s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:25 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb" returned: 0 in 0.726s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53381aaa-b011-425e-9334-d0b237dedf24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ba23d-12c8-4e98-bbaa-7e2b1b3aceb0]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:25 devstack sudo[85326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea Apr 09 17:33:25 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:25 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 Apr 09 17:33:25 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:25 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05f2d687-57cc-4921-aa22-fc3b7d60897d,created_at=2026-04-09T15:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648951032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05f2d687-57cc-4921-aa22-fc3b7d60897d,host='devstack@QuobyteHD#QuobyteHD',id=abeebd6d-97af-431b-b7fc-206d0039cf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d9eebbdf984537a38ea2266cf528e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:25Z,use_quota=True,user_id='db9344d1350346a8a1ad607ee0d9a1bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6b136b0-c76a-4b6e-ac36-9a716c4c946c),volume_type_id=f6b136b0-c76a-4b6e-ac36-9a716c4c946c)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Creating volume abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:25 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f060ad-3a8d-47b2-8efe-42aa959e5dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49f2169-0862-4097-883d-9d391a251ab5', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2283fc8-82a3-45c2-a261-87f46959df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:25 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 1073741824 Apr 09 17:33:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Volume volume-f49f2169-0862-4097-883d-9d391a251ab5 (f49f2169-0862-4097-883d-9d391a251ab5): created successfully Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2283fc8-82a3-45c2-a261-87f46959df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:25 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Flow 'volume_create_manager' (99805c6d-dd7a-4912-be2a-3f404893196b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-23f6b71e-81e7-4a8e-a1a1-70673fb84d33 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Created volume successfully. Apr 09 17:33:26 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24" returned: 0 in 0.502s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:26 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb Apr 09 17:33:26 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:26 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea" returned: 1 in 0.600s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_7_yd8jea' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3363175-79aa-46b6-930d-444ff48c8df2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:26 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD Apr 09 17:33:26 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:26 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 1073741824" returned: 0 in 0.658s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:26 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:26 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:26 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb" returned: 0 in 0.621s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:26 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb Apr 09 17:33:26 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:26 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] e1c6f14c-6844-4aad-9551-57f242d39ddc was qcow2, converting to raw {{(pid=82701) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 17:33:27 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.528s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149d1008-c9f7-4f74-bf66-9a7867139e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abeebd6d-97af-431b-b7fc-206d0039cf61', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2391ee-f5f2-42ef-9f54-9580555204ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:27 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:33:27 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:27 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Volume volume-abeebd6d-97af-431b-b7fc-206d0039cf61 (abeebd6d-97af-431b-b7fc-206d0039cf61): created successfully Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2391ee-f5f2-42ef-9f54-9580555204ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Flow 'volume_create_manager' (c9ed8947-cf0a-441c-948a-b22b7a649f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:27 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d2822e4b-e52f-4058-8c38-6564b9a7076f tempest-GroupsV314Test-505929731 None] Created volume successfully. Apr 09 17:33:27 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24.40c7a427-36ff-4f31-b583-2b6506cff6bb" returned: 0 in 0.517s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-40c7a427-36ff-4f31-b583-2b6506cff6bb" released by "_delete_snapshot" :: held 2.446s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-53381aaa-b011-425e-9334-d0b237dedf24" released by "delete_snapshot" :: held 2.484s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-3200ef46-48c5-4e48-991a-297f33d2368e" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-3200ef46-48c5-4e48-991a-297f33d2368e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-668d3e4e-6f0c-4bab-a371-4c1083b908ef" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-668d3e4e-6f0c-4bab-a371-4c1083b908ef" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Deleting offline snapshot 668d3e4e-6f0c-4bab-a371-4c1083b908ef of volume 3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] snapshot_file for this snap is: volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Acquiring lock "cinder-f49f2169-0862-4097-883d-9d391a251ab5-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "cinder-f49f2169-0862-4097-883d-9d391a251ab5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d521a9-8a45-4be1-8461-87abb8f75cc6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Acquiring lock "cinder-quobyte-f49f2169-0862-4097-883d-9d391a251ab5" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "cinder-quobyte-f49f2169-0862-4097-883d-9d391a251ab5" acquired by "delete_volume" :: waited 0.018s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafd2c4c-2760-4d72-a1c4-be2b32891b79]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:27 devstack sudo[85359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef Apr 09 17:33:27 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:27 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 Apr 09 17:33:27 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef" returned: 0 in 0.705s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3200ef46-48c5-4e48-991a-297f33d2368e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48fbec6-f263-4101-a0a0-8afc8b2c88cc]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:28 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5" returned: 0 in 0.700s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:28 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e Apr 09 17:33:28 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack sudo[85385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5 Apr 09 17:33:28 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 0 in 1.223s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_wwsa9jd6devstack@QuobyteHD, size 112.00 MB, duration 1.22 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:33:28 devstack cinder-volume[82701]: INFO cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Converted 112.00 MB image at 91.44 MB/s Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:28 devstack sudo[85388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 1G Apr 09 17:33:28 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:28 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Cloning volume abeebd6d-97af-431b-b7fc-206d0039cf61 to volume f0603f84-8394-4204-97ba-aefaafb91581 Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Creating offline snapshot cb5aff5a-e0b3-4b98-a626-f5ff3107a54c of volume abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bdf6b-395d-46fe-9ed3-daa6bfa1818d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:28 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:28 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f49f2169-0862-4097-883d-9d391a251ab5" returned: 0 in 0.581s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "cinder-quobyte-f49f2169-0862-4097-883d-9d391a251ab5" released by "delete_volume" :: held 1.308s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Created reservations ['aaee2df1-1aba-4f21-9237-7bc8d1abfb74', '7568b82a-0426-4ac1-8d89-fade792f80af', '63a0e393-1e69-448a-af7b-38b659055e3f', '40ccbe55-0269-4840-a041-e3e61775362c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:28 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e" returned: 0 in 0.765s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:28 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:28 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef Apr 09 17:33:28 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:28 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 1G" returned: 0 in 0.755s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e620e1c-d986-41cf-a27b-bbe98c046a57]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:29 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.723s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:29 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c 1G Apr 09 17:33:29 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:29 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:33:29 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:29 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.644s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:29 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Deleted volume successfully. Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8ee6f66f-b2e6-4caf-813e-6770688e4802 tempest-VolumeQuotasNegativeTestJSON-741033604 None] Lock "cinder-f49f2169-0862-4097-883d-9d391a251ab5-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:29 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef" returned: 0 in 0.739s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:29 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef Apr 09 17:33:29 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:29 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 0 in 0.895s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:29 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c 1G" returned: 0 in 0.823s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abeebd6d-97af-431b-b7fc-206d0039cf61 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:29 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abeebd6d-97af-431b-b7fc-206d0039cf61 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c Apr 09 17:33:29 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:30 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:33:30 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:30 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e.668d3e4e-6f0c-4bab-a371-4c1083b908ef" returned: 0 in 0.582s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-668d3e4e-6f0c-4bab-a371-4c1083b908ef" released by "_delete_snapshot" :: held 2.884s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-3200ef46-48c5-4e48-991a-297f33d2368e" released by "delete_snapshot" :: held 2.898s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:30 devstack cinder-volume[82701]: WARNING cinder.quota [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-67631368 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-67631368, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:30 devstack cinder-volume[82701]: WARNING cinder.quota [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-67631368 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-67631368, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['8331b441-a6ab-416c-a2b7-90db5d263b55', '7fbb5dcd-5cd0-4826-9aad-b134782b85c8', 'c5aede3b-1236-4399-90c1-bc0ff449e598', 'b1a95ddb-91bf-409f-b260-d96cd936830a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['07d0abe9-8b3e-48d8-86eb-737f425510ac', 'c132edd9-946d-471a-9033-f5211d62d1b6', '9505024a-c702-4a42-bd19-65678eabcb52', 'faac3d8e-965a-418a-9b67-882ef55cae1a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-64aed3bf-7cda-4045-be19-c9bd1c5a6927 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot 795fb4f0-0029-4665-a56a-5af94f2d1722: deleted successfully Apr 09 17:33:30 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 1 in 0.880s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Downloaded image e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume 4b169f18-4218-4750-8681-393f814c3f49 successfully. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc for user c52d4c5acd03466e98e20557337f22cb is deleted. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Marking volume 4b169f18-4218-4750-8681-393f814c3f49 as bootable. {{(pid=82701) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Copying metadata from image e1c6f14c-6844-4aad-9551-57f242d39ddc to 4b169f18-4218-4750-8681-393f814c3f49. {{(pid=82701) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Creating volume glance metadata for volume 4b169f18-4218-4750-8681-393f814c3f49 backed by image e1c6f14c-6844-4aad-9551-57f242d39ddc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82701) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 17:33:30 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abeebd6d-97af-431b-b7fc-206d0039cf61 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" returned: 0 in 0.883s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:30 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:30 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c Apr 09 17:33:30 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d515b9-509d-4772-9693-b41953efb098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b169f18-4218-4750-8681-393f814c3f49', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc91d364-1128-4f04-86d1-596de0a04995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:30 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Volume volume-4b169f18-4218-4750-8681-393f814c3f49 (4b169f18-4218-4750-8681-393f814c3f49): created successfully Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc91d364-1128-4f04-86d1-596de0a04995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Flow 'volume_create_manager' (82d76f04-09d2-46ea-8087-ac2a8fcf7c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-78aed37d-ccc2-48bb-b3bc-08d65cda2c46 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Created volume successfully. Apr 09 17:33:31 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-3200ef46-48c5-4e48-991a-297f33d2368e" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-3200ef46-48c5-4e48-991a-297f33d2368e" acquired by "delete_volume" :: waited 0.030s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:31 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[54236fa0-5cee-4b91-bb54-2bc7f3687157]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:31 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info Apr 09 17:33:31 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:31 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e Apr 09 17:33:31 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:32 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e" returned: 0 in 0.605s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:32 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e Apr 09 17:33:32 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:32 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info" returned: 0 in 0.662s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:32 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:32 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info Apr 09 17:33:32 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:32 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3200ef46-48c5-4e48-991a-297f33d2368e" returned: 0 in 0.542s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-3200ef46-48c5-4e48-991a-297f33d2368e" released by "delete_volume" :: held 1.198s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-53381aaa-b011-425e-9334-d0b237dedf24" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-53381aaa-b011-425e-9334-d0b237dedf24" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf3a5d0-b65c-49c4-a694-b87e9e87e382]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:32 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.info" returned: 0 in 0.569s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Acquiring lock "cinder-quobyte-f0603f84-8394-4204-97ba-aefaafb91581" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-f0603f84-8394-4204-97ba-aefaafb91581" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] snapshot: cb5aff5a-e0b3-4b98-a626-f5ff3107a54c, volume: f0603f84-8394-4204-97ba-aefaafb91581, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7105a6bf-b291-4c5a-8d9a-72d7975ec75f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:32 devstack sudo[85452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 Apr 09 17:33:32 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:32 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c Apr 09 17:33:32 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:33 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" returned: 0 in 0.648s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abeebd6d-97af-431b-b7fc-206d0039cf61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79cde85-cbf2-4fb2-ade0-7c57b4158ec8]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:33 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24" returned: 0 in 0.730s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:33 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24 Apr 09 17:33:33 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:33 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:33 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Flow 'volume_create_manager' (8f4faf78-9e61-43ac-864d-7b4aeeb1669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc010f1d-b39a-45a1-a9b9-80f771c609e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc010f1d-b39a-45a1-a9b9-80f771c609e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1733350440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8638e50-0981-408d-a5c7-b0460cd9a902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9aa68835404219bfc9250c40fcfa2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:34Z,use_quota=True,user_id='c63d33694b8c4a4896d094a69e209952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2974cf2b-2fbc-4153-ace8-9259a8f81f93),volume_type_id=2974cf2b-2fbc-4153-ace8-9259a8f81f93)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1696c272-b175-464f-8be6-1fd7f44ec87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1696c272-b175-464f-8be6-1fd7f44ec87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db94517-0d83-4593-8cd9-fb131465558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db94517-0d83-4593-8cd9-fb131465558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8638e50-0981-408d-a5c7-b0460cd9a902', 'volume_name': 'volume-f8638e50-0981-408d-a5c7-b0460cd9a902', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8266d01f-b003-4e43-b65b-3f689ba28790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8266d01f-b003-4e43-b65b-3f689ba28790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f3beb7-e23f-477e-9ba9-93ade4a6b936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:33 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Volume f8638e50-0981-408d-a5c7-b0460cd9a902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8638e50-0981-408d-a5c7-b0460cd9a902', 'volume_size': 1} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:34 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.598s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:34 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-53381aaa-b011-425e-9334-d0b237dedf24" returned: 0 in 0.587s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:34 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 Apr 09 17:33:34 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-53381aaa-b011-425e-9334-d0b237dedf24" released by "delete_volume" :: held 1.359s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['76dcec7a-aa6e-45f9-b3ad-9cda1552159e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:34 devstack cinder-volume[82701]: WARNING cinder.quota [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-67631368 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-67631368, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['9b13c486-c95c-4f81-8eeb-26ce085f8606', '9e83c86e-4631-4347-bf37-57cfdbf747f5', '5babab6f-233b-4f25-9907-429316d9f6e3', '02bf9bb6-96e2-4887-9e30-55a137bd7370'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['796cc1fb-709b-4d46-a00e-908ea1c8b05b', '1341e4e4-e477-4ee0-904a-545c1c25368b', '4837c65a-43f9-441c-be96-84c6dc2f83e2', 'f28962d1-a6e0-4682-95e7-e318fa72281a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:34 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:34 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:35 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.757s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:35 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-358c74c5-27cc-43fd-8a7a-4459864b618d tempest-GroupSnapshotsTest-2066517290 None] Delete group completed successfully. Apr 09 17:33:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c05ab5dc-da10-4a47-8dc4-99bf5e63a198 tempest-GroupSnapshotsTest-2066517290 None] Group tempest-GroupSnapshotsTest-Group-1295779239: creating Apr 09 17:33:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c05ab5dc-da10-4a47-8dc4-99bf5e63a198 tempest-GroupSnapshotsTest-2066517290 None] Group tempest-GroupSnapshotsTest-Group-1295779239: created successfully Apr 09 17:33:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c05ab5dc-da10-4a47-8dc4-99bf5e63a198 tempest-GroupSnapshotsTest-2066517290 None] Create group completed successfully. Apr 09 17:33:36 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581" returned: 0 in 2.370s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8522c-9458-4913-b654-fa5a15c72264]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:36 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:36 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (fcfbf70b-1a39-407b-a744-dda6a20f1276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56513658-d7ca-4252-b4e4-581a9787af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56513658-d7ca-4252-b4e4-581a9787af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295637773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42e8b9ce-4f47-4a3c-b6ac-f6e43ad00fdd,host='devstack@QuobyteHD#QuobyteHD',id=cf460b28-a8a1-43d4-9db1-42b605352f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:37Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(571705f5-1d97-4e16-b04b-9affb1b8f8ea),volume_type_id=571705f5-1d97-4e16-b04b-9affb1b8f8ea)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9782aa59-e554-477b-95c6-2ab2b754afd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9782aa59-e554-477b-95c6-2ab2b754afd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5c2c88-199b-497b-8c02-9ce3f7dc905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5c2c88-199b-497b-8c02-9ce3f7dc905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf460b28-a8a1-43d4-9db1-42b605352f41', 'volume_name': 'volume-cf460b28-a8a1-43d4-9db1-42b605352f41', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6003919-e91d-43e9-9bc0-cc84d351b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6003919-e91d-43e9-9bc0-cc84d351b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b7672f-49b9-42e9-a360-f6e88b67bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:36 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Volume cf460b28-a8a1-43d4-9db1-42b605352f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf460b28-a8a1-43d4-9db1-42b605352f41', 'volume_size': 1} Apr 09 17:33:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:37 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.656s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:33:37 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Converted 1024.00 MB image at 431.94 MB/s Apr 09 17:33:37 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:37 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 Apr 09 17:33:37 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:37 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581" returned: 0 in 0.409s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-f0603f84-8394-4204-97ba-aefaafb91581" released by "_copy_volume_from_snapshot" :: held 4.729s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Acquiring lock "cinder-quobyte-cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Deleting offline snapshot cb5aff5a-e0b3-4b98-a626-f5ff3107a54c of volume abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] snapshot_file for this snap is: volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119a1d0-9b50-49f5-b31e-1016b663cbf6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:37 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c Apr 09 17:33:37 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:38 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abeebd6d-97af-431b-b7fc-206d0039cf61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97db3b2-2d2d-417f-ac43-6b36407d713e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:38 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:38 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:38 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.452s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:38 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c Apr 09 17:33:38 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:38 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:38 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c Apr 09 17:33:38 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:39 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61.cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" returned: 0 in 0.415s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-cb5aff5a-e0b3-4b98-a626-f5ff3107a54c" released by "_delete_snapshot" :: held 1.869s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:UPDATE=170,cinder:SELECT=178,cinder:INSERT=40,cinder:DELETE=7 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=168,cinder:UPDATE=154,cinder:INSERT=42,cinder:DELETE=5 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.632s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1733350440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8638e50-0981-408d-a5c7-b0460cd9a902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9aa68835404219bfc9250c40fcfa2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:34Z,use_quota=True,user_id='c63d33694b8c4a4896d094a69e209952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2974cf2b-2fbc-4153-ace8-9259a8f81f93),volume_type_id=2974cf2b-2fbc-4153-ace8-9259a8f81f93)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Creating volume f8638e50-0981-408d-a5c7-b0460cd9a902 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:39 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:39 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 1073741824 Apr 09 17:33:39 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d149f2a3-6eb3-4bbc-8037-d7d2b3000fc2 tempest-GroupsV314Test-505929731 None] Create group from source-group-05f2d687-57cc-4921-aa22-fc3b7d60897d completed successfully. Apr 09 17:33:39 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 1073741824" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:39 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 Apr 09 17:33:39 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Acquiring lock "cinder-quobyte-f0603f84-8394-4204-97ba-aefaafb91581" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-f0603f84-8394-4204-97ba-aefaafb91581" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20fb255-0e29-4f81-a675-cf85a2f202a2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:40 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 Apr 09 17:33:40 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:40 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.671s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f3beb7-e23f-477e-9ba9-93ade4a6b936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8638e50-0981-408d-a5c7-b0460cd9a902', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5335e37a-8ddb-4a6a-99e9-59061f779829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d39d6b-8736-4e64-a99c-da0541f3b6a7]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Volume volume-f8638e50-0981-408d-a5c7-b0460cd9a902 (f8638e50-0981-408d-a5c7-b0460cd9a902): created successfully Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5335e37a-8ddb-4a6a-99e9-59061f779829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Flow 'volume_create_manager' (8f4faf78-9e61-43ac-864d-7b4aeeb1669e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:40 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-87766415-227d-4241-8180-7cc5993ccb31 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Created volume successfully. Apr 09 17:33:40 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:33:40 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:40 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581" returned: 0 in 0.557s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:40 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581 Apr 09 17:33:40 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:40 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 0 in 0.466s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:40 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f0603f84-8394-4204-97ba-aefaafb91581" returned: 0 in 0.402s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-f0603f84-8394-4204-97ba-aefaafb91581" released by "delete_volume" :: held 0.982s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:41 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:33:41 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Created reservations ['f9e76f04-f616-48c3-b86a-eb0a422c71c5'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:41 devstack cinder-volume[82701]: WARNING cinder.quota [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1201020 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1201020, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:41 devstack cinder-volume[82701]: WARNING cinder.quota [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1201020 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1201020, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Created reservations ['5549665a-35e9-4434-84fc-ba39d626b8a3', '151b3eb9-f9c2-42dd-a16f-3b4d7c1a4c7e', '71262c5d-f871-4774-b729-82e26956660d', '470bda83-ee1e-443d-bf49-40966bdbc3cb'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:41 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:41 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:41 devstack sudo[85544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:41 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:41 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 1 in 0.521s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.035s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.560s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42e8b9ce-4f47-4a3c-b6ac-f6e43ad00fdd,created_at=2026-04-09T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295637773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42e8b9ce-4f47-4a3c-b6ac-f6e43ad00fdd,host='devstack@QuobyteHD#QuobyteHD',id=cf460b28-a8a1-43d4-9db1-42b605352f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bfbc880cea4306aef6ef4947ab3a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:37Z,use_quota=True,user_id='36f527a4efe64d74adb26b8199332c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(571705f5-1d97-4e16-b04b-9affb1b8f8ea),volume_type_id=571705f5-1d97-4e16-b04b-9affb1b8f8ea)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Creating volume cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:41 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:41 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 1073741824 Apr 09 17:33:41 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Acquiring lock "cinder-quobyte-abeebd6d-97af-431b-b7fc-206d0039cf61" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6', 'name': 'volume-4b169f18-4218-4750-8681-393f814c3f49', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e95b577-b091-4980-a423-c36f7a84c181', 'enforce_multipath': True} {{(pid=82701) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-abeebd6d-97af-431b-b7fc-206d0039cf61" acquired by "delete_volume" :: waited 0.033s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a2531a-c915-4be4-91f1-fef73b164728]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:41 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.544s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a706ebea-ad72-4ca1-8448-8b9653e7920c tempest-GroupsV314Test-505929731 None] Delete group completed successfully. Apr 09 17:33:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-d2416d83-7199-4df6-ab48-9fb19b186b08 req-e41e0577-4011-445b-8246-83c2dfc82d7c tempest-ServerBootFromVolumeStableRescueTest-230694727 None] attachment_update completed successfully. Apr 09 17:33:41 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:41 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Acquiring lock "cinder-f8638e50-0981-408d-a5c7-b0460cd9a902-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "cinder-f8638e50-0981-408d-a5c7-b0460cd9a902-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Acquiring lock "cinder-quobyte-f8638e50-0981-408d-a5c7-b0460cd9a902" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "cinder-quobyte-f8638e50-0981-408d-a5c7-b0460cd9a902" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a787e412-c746-4e51-b176-8eb287fe6cd8]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:41 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.555s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:41 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9a7898ef-a695-4557-9484-dff5acb36513 tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Retype volume completed successfully. Apr 09 17:33:41 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 Apr 09 17:33:41 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:42 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 1073741824" returned: 0 in 0.691s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:42 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 Apr 09 17:33:42 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:42 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.621s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:42 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61 Apr 09 17:33:42 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:42 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902" returned: 0 in 0.479s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:42 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902 Apr 09 17:33:42 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:42 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b7672f-49b9-42e9-a360-f6e88b67bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf460b28-a8a1-43d4-9db1-42b605352f41', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076ec70c-0f31-46ad-9dbc-b9c6fda8073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:42 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Volume volume-cf460b28-a8a1-43d4-9db1-42b605352f41 (cf460b28-a8a1-43d4-9db1-42b605352f41): created successfully Apr 09 17:33:42 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076ec70c-0f31-46ad-9dbc-b9c6fda8073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Flow 'volume_create_manager' (fcfbf70b-1a39-407b-a744-dda6a20f1276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-abeebd6d-97af-431b-b7fc-206d0039cf61" returned: 0 in 0.431s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Lock "cinder-quobyte-abeebd6d-97af-431b-b7fc-206d0039cf61" released by "delete_volume" :: held 1.099s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:42 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-fd67a644-5224-414f-a987-5473bdd8de19 tempest-GroupSnapshotsTest-2066517290 None] Created volume successfully. Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Created reservations ['37631e19-ec82-4f89-b890-3b0c4cad9155'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:42 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f8638e50-0981-408d-a5c7-b0460cd9a902" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "cinder-quobyte-f8638e50-0981-408d-a5c7-b0460cd9a902" released by "delete_volume" :: held 0.937s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Created reservations ['6c73e004-dbd9-4ec7-ae57-ee231f5b4704', 'bc3b6c57-5d11-4945-ac41-76d70a1bf722', '322607a5-a63f-4da4-902d-57572bf8ece2', '3c0fc6fe-5ca0-43f1-be65-04f5355fdfcb'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:42 devstack cinder-volume[82701]: WARNING cinder.quota [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:42 devstack cinder-volume[82701]: WARNING cinder.quota [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Created reservations ['492a05cf-81ee-4f2d-b7f7-323484c6ea8a', '39fb1cfe-f16a-4480-824b-84165fcb1b20', '5731fd41-2f8b-425f-b1a8-c32b76f39b0c', '9a77d4f6-fcea-4445-8dbb-05c5c15ac650'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:42 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:42 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:42 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:42 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:43 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.439s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-35f50904-2346-477a-b534-e45467ba9b08 tempest-GroupsV314Test-505929731 None] Delete group completed successfully. Apr 09 17:33:43 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.486s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Deleted volume successfully. Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-25705846-0614-49df-b8f7-4f095e5bfcaa tempest-VolumeRetypeWithoutMigrationTest-754016957 None] Lock "cinder-f8638e50-0981-408d-a5c7-b0460cd9a902-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] GroupSnapshot af972e83-c1d1-4bac-b575-c28bd330130b: creating. Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Group snapshot af972e83-c1d1-4bac-b575-c28bd330130b: creating. {{(pid=82701) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Creating offline snapshot dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 of volume cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6864756-380d-44ea-8100-5c8dfb049ad4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:43 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 Apr 09 17:33:43 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:44 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41" returned: 0 in 0.593s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:44 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 1G Apr 09 17:33:44 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:44 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 1G" returned: 0 in 0.640s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf460b28-a8a1-43d4-9db1-42b605352f41 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:44 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf460b28-a8a1-43d4-9db1-42b605352f41 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 Apr 09 17:33:44 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:45 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf460b28-a8a1-43d4-9db1-42b605352f41 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" returned: 0 in 0.607s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:45 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:45 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 Apr 09 17:33:45 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:46 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" returned: 0 in 0.570s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:46 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info Apr 09 17:33:46 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:46 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info" returned: 0 in 0.722s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:46 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:33:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:46 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info Apr 09 17:33:46 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:47 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.info" returned: 0 in 0.723s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.931s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-581309d5-94b1-495f-8ab2-1c2f94bd576d tempest-GroupSnapshotsTest-2066517290 None] group_snapshot af972e83-c1d1-4bac-b575-c28bd330130b: created successfully Apr 09 17:33:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot af972e83-c1d1-4bac-b575-c28bd330130b: deleting Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot af972e83-c1d1-4bac-b575-c28bd330130b: deleting {{(pid=82701) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-cf460b28-a8a1-43d4-9db1-42b605352f41" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-cf460b28-a8a1-43d4-9db1-42b605352f41" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Deleting offline snapshot dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 of volume cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] snapshot_file for this snap is: volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4469bf0c-312b-4247-b855-e334a04f90f2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:48 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 Apr 09 17:33:48 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:48 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" returned: 0 in 0.749s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf460b28-a8a1-43d4-9db1-42b605352f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb5910-4e54-412e-a06d-9e077440de5b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:48 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 Apr 09 17:33:48 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:49 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41" returned: 0 in 0.839s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:49 devstack sudo[85648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 Apr 09 17:33:49 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:50 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" returned: 0 in 0.653s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:50 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81 Apr 09 17:33:50 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:51 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41.dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" returned: 0 in 0.787s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-dc7e938f-61db-40a9-8c2c-c07fe8dbbd81" released by "_delete_snapshot" :: held 3.159s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-cf460b28-a8a1-43d4-9db1-42b605352f41" released by "delete_snapshot" :: held 3.171s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:51 devstack cinder-volume[82701]: WARNING cinder.quota [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-619755600 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-619755600, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:51 devstack cinder-volume[82701]: WARNING cinder.quota [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-619755600 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-619755600, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['478da4b5-74a4-4382-a418-cf63d5042c50', '51766e01-3406-4a45-81fa-7598672924fd', '429e67d4-5b50-4709-92b6-8075450c356d', '8ce03979-8a81-4110-ac36-6ac4b63b40df'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:51 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-46a16a5a-a479-4df3-8548-4e082ebc9de5 tempest-GroupSnapshotsTest-2066517290 None] group_snapshot af972e83-c1d1-4bac-b575-c28bd330130b: deleted successfully Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "cinder-quobyte-cf460b28-a8a1-43d4-9db1-42b605352f41" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-cf460b28-a8a1-43d4-9db1-42b605352f41" acquired by "delete_volume" :: waited 0.025s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed0b6f8-ec10-469b-9324-e22ac8b64800]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:51 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 Apr 09 17:33:51 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Flow 'volume_create_manager' (cfedec4d-3f65-4723-afc4-c2a9218dea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:51 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e820ee5d-5a42-4380-884a-9bfe3556f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e820ee5d-5a42-4380-884a-9bfe3556f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1694098639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51796e46-716e-4138-8f1a-ea082b732110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53125d54f8d645198f3416fcc61d9a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:52Z,use_quota=True,user_id='270f5d2687b845aeb79e42d2ee7259b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32a0a2d-cd6e-4a8d-93e7-4f661977adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32a0a2d-cd6e-4a8d-93e7-4f661977adc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343009da-53c0-42ee-803b-073455d5aabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343009da-53c0-42ee-803b-073455d5aabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51796e46-716e-4138-8f1a-ea082b732110', 'volume_name': 'volume-51796e46-716e-4138-8f1a-ea082b732110', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0294ef04-b634-45aa-aef4-6d3ce7daecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0294ef04-b634-45aa-aef4-6d3ce7daecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dbecae-d01c-45f5-a982-9fe2e9593056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:52 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Volume 51796e46-716e-4138-8f1a-ea082b732110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51796e46-716e-4138-8f1a-ea082b732110', 'volume_size': 1} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1694098639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51796e46-716e-4138-8f1a-ea082b732110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53125d54f8d645198f3416fcc61d9a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:52Z,use_quota=True,user_id='270f5d2687b845aeb79e42d2ee7259b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Creating volume 51796e46-716e-4138-8f1a-ea082b732110 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:52 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:52 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 1073741824 Apr 09 17:33:52 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:52 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41" returned: 0 in 0.748s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:52 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41 Apr 09 17:33:52 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:52 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 1073741824" returned: 0 in 0.538s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:52 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 Apr 09 17:33:52 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:52 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-cf460b28-a8a1-43d4-9db1-42b605352f41" returned: 0 in 0.465s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Lock "cinder-quobyte-cf460b28-a8a1-43d4-9db1-42b605352f41" released by "delete_volume" :: held 1.269s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:33:52 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['807f4f59-1f90-4335-891d-19a3b7207f62'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:52 devstack cinder-volume[82701]: WARNING cinder.quota [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-619755600 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-619755600, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Created reservations ['a35b4358-e3c2-4502-911e-958be0a45138', 'b1afaa38-3ad9-400e-8683-9b833b77755d', 'a1fd14b6-aef6-4519-87d4-d4b79d428a4f', '571d21b7-b932-4a63-bd67-69dd9bc4db85'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:53 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:53 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:53 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110" returned: 0 in 0.684s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dbecae-d01c-45f5-a982-9fe2e9593056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51796e46-716e-4138-8f1a-ea082b732110', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48216dd0-cde1-4fe4-b3f6-941fb62380ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:53 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Volume volume-51796e46-716e-4138-8f1a-ea082b732110 (51796e46-716e-4138-8f1a-ea082b732110): created successfully Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48216dd0-cde1-4fe4-b3f6-941fb62380ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Flow 'volume_create_manager' (cfedec4d-3f65-4723-afc4-c2a9218dea10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-01611d33-5f20-49d8-a33f-737d8642614f tempest-VolumesListAdminTestJSON-2032903779 None] Created volume successfully. Apr 09 17:33:53 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.666s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:53 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-df1edc7c-0407-4701-89d3-940ad2d4fe4a tempest-GroupSnapshotsTest-2066517290 None] Delete group completed successfully. Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Flow 'volume_create_manager' (a30f68a9-af50-4c08-83bc-4a47f86b60b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385a7d0c-bb89-4c4f-a564-ec041c2e8f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385a7d0c-bb89-4c4f-a564-ec041c2e8f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1761180237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caed23d-afb8-4adc-9f22-a3303d24922d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53125d54f8d645198f3416fcc61d9a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:54Z,use_quota=True,user_id='270f5d2687b845aeb79e42d2ee7259b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36496b14-7b33-4550-9605-a68539120a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36496b14-7b33-4550-9605-a68539120a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e349c9-db67-4378-a685-287147d29550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e349c9-db67-4378-a685-287147d29550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9caed23d-afb8-4adc-9f22-a3303d24922d', 'volume_name': 'volume-9caed23d-afb8-4adc-9f22-a3303d24922d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02201300-9c9e-481f-9479-946497a77425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02201300-9c9e-481f-9479-946497a77425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d9fe8a-a19f-4823-8f71-8bceba46d66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Volume 9caed23d-afb8-4adc-9f22-a3303d24922d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9caed23d-afb8-4adc-9f22-a3303d24922d', 'volume_size': 1} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1761180237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caed23d-afb8-4adc-9f22-a3303d24922d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53125d54f8d645198f3416fcc61d9a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:54Z,use_quota=True,user_id='270f5d2687b845aeb79e42d2ee7259b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Creating volume 9caed23d-afb8-4adc-9f22-a3303d24922d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:54 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:54 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d 1073741824 Apr 09 17:33:54 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:55 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d 1073741824" returned: 0 in 0.748s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:55 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d Apr 09 17:33:55 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:55 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d" returned: 0 in 0.450s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d9fe8a-a19f-4823-8f71-8bceba46d66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9caed23d-afb8-4adc-9f22-a3303d24922d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4df39-7ef3-41da-827e-757a36f8d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:55 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Volume volume-9caed23d-afb8-4adc-9f22-a3303d24922d (9caed23d-afb8-4adc-9f22-a3303d24922d): created successfully Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4df39-7ef3-41da-827e-757a36f8d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Flow 'volume_create_manager' (a30f68a9-af50-4c08-83bc-4a47f86b60b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:55 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-008deb15-6532-4058-b2d6-ad7b4f09691e tempest-VolumesListAdminTestJSON-2032903779 None] Created volume successfully. Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Flow 'volume_create_manager' (98567102-931f-4c77-a69b-c000d06920a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624fae0d-f68f-4277-9b19-60e6250d654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624fae0d-f68f-4277-9b19-60e6250d654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1067778719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc32dac5-63bf-4b3a-9350-1b833c0a9bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53125d54f8d645198f3416fcc61d9a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:57Z,use_quota=True,user_id='270f5d2687b845aeb79e42d2ee7259b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12167bb8-d834-4283-aba3-e207f290110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12167bb8-d834-4283-aba3-e207f290110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8e8a87-6071-40bc-8949-988b60167034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8e8a87-6071-40bc-8949-988b60167034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc32dac5-63bf-4b3a-9350-1b833c0a9bff', 'volume_name': 'volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6cad4e-09f5-4585-b6ef-1f58640ec1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6cad4e-09f5-4585-b6ef-1f58640ec1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ca8270-b956-41c6-90d0-480a6181274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:56 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Volume fc32dac5-63bf-4b3a-9350-1b833c0a9bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff', 'volume_size': 1} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1067778719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc32dac5-63bf-4b3a-9350-1b833c0a9bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53125d54f8d645198f3416fcc61d9a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:57Z,use_quota=True,user_id='270f5d2687b845aeb79e42d2ee7259b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Creating volume fc32dac5-63bf-4b3a-9350-1b833c0a9bff {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:56 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:56 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff 1073741824 Apr 09 17:33:56 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1814170e-ad52-4d47-bc6e-50076a64b826 tempest-GroupsV320Test-1906027217 None] Group tempest-GroupsV320Test-Group-1282130097: creating Apr 09 17:33:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1814170e-ad52-4d47-bc6e-50076a64b826 tempest-GroupsV320Test-1906027217 None] Group tempest-GroupsV320Test-Group-1282130097: created successfully Apr 09 17:33:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1814170e-ad52-4d47-bc6e-50076a64b826 tempest-GroupsV320Test-1906027217 None] Create group completed successfully. Apr 09 17:33:57 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff 1073741824" returned: 0 in 0.629s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:57 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff Apr 09 17:33:57 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:57 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ca8270-b956-41c6-90d0-480a6181274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9a3043-0eb7-4f73-92a0-301f3cdc21a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:57 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Volume volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff (fc32dac5-63bf-4b3a-9350-1b833c0a9bff): created successfully Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9a3043-0eb7-4f73-92a0-301f3cdc21a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Flow 'volume_create_manager' (98567102-931f-4c77-a69b-c000d06920a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-bc613964-686c-47a9-838f-fa1e8c1bc848 tempest-VolumesListAdminTestJSON-2032903779 None] Created volume successfully. Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Created reservations ['75f08be2-b6c6-4d82-81b2-a5a39acf5faa'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:58 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:33:58 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:33:59 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.482s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:33:59 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d19c1b30-5c39-4bf5-8e98-eef4739c80bf tempest-GroupsV320Test-1906027217 None] Delete group completed successfully. Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Flow 'volume_create_manager' (88e25831-dd5d-424c-87c4-4d0ecd4b287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf581c44-39ae-4993-9f1f-f46708635ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf581c44-39ae-4993-9f1f-f46708635ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8832516b-ad50-4d9f-b53c-5b8516891606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac9253bebec42e18da1b3af3c9b7f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:59Z,use_quota=True,user_id='5dbb3337506547ed905e4dbd7fa7da34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47db8d61-8c96-4997-8f1b-11c72b52983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47db8d61-8c96-4997-8f1b-11c72b52983f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32325d8b-6ab2-48a9-9fea-c23b5a19a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32325d8b-6ab2-48a9-9fea-c23b5a19a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8832516b-ad50-4d9f-b53c-5b8516891606', 'volume_name': 'volume-8832516b-ad50-4d9f-b53c-5b8516891606', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dcc82f-3f98-4ccb-8af9-9779ae5ecec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dcc82f-3f98-4ccb-8af9-9779ae5ecec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a9f635-e04a-483f-af87-cf8d8c5f1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:33:59 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Volume 8832516b-ad50-4d9f-b53c-5b8516891606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8832516b-ad50-4d9f-b53c-5b8516891606', 'volume_size': 1} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8832516b-ad50-4d9f-b53c-5b8516891606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac9253bebec42e18da1b3af3c9b7f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:33:59Z,use_quota=True,user_id='5dbb3337506547ed905e4dbd7fa7da34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Creating volume 8832516b-ad50-4d9f-b53c-5b8516891606 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:33:59 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:33:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:33:59 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 1073741824 Apr 09 17:33:59 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:00 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 1073741824" returned: 0 in 0.856s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:00 devstack sudo[85790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 Apr 09 17:34:00 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:00 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606" returned: 0 in 0.584s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a9f635-e04a-483f-af87-cf8d8c5f1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8832516b-ad50-4d9f-b53c-5b8516891606', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884887a3-933d-448c-a8ca-19be85da0f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:01 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Volume volume-8832516b-ad50-4d9f-b53c-5b8516891606 (8832516b-ad50-4d9f-b53c-5b8516891606): created successfully Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884887a3-933d-448c-a8ca-19be85da0f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Flow 'volume_create_manager' (88e25831-dd5d-424c-87c4-4d0ecd4b287d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:01 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8a0d324d-5625-4fc5-b5b0-90fea2215c1e tempest-VolumesListAdminTestJSON-1478756090 None] Created volume successfully. Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Acquiring lock "cinder-8832516b-ad50-4d9f-b53c-5b8516891606-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Lock "cinder-8832516b-ad50-4d9f-b53c-5b8516891606-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Acquiring lock "cinder-quobyte-8832516b-ad50-4d9f-b53c-5b8516891606" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Lock "cinder-quobyte-8832516b-ad50-4d9f-b53c-5b8516891606" acquired by "delete_volume" :: waited 0.027s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "cinder-fc32dac5-63bf-4b3a-9350-1b833c0a9bff-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608b202-ea37-4138-9344-9ee8d29e63ff]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-fc32dac5-63bf-4b3a-9350-1b833c0a9bff-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "cinder-quobyte-fc32dac5-63bf-4b3a-9350-1b833c0a9bff" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:02 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 Apr 09 17:34:02 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-quobyte-fc32dac5-63bf-4b3a-9350-1b833c0a9bff" acquired by "delete_volume" :: waited 0.036s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb674c44-1a59-4b15-b03a-e84fb041077c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:02 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff Apr 09 17:34:02 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Flow 'volume_create_manager' (6f786a00-a496-4591-9fcc-8151cb874b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9764c0d-d06b-4e20-bc9c-f1c35e30668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9764c0d-d06b-4e20-bc9c-f1c35e30668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-616004428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7916b67d-937f-4707-81af-de76c0416950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d1e453f44344e69e42dc638bf27a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:03Z,use_quota=True,user_id='c9313bcbd0de49e180b6c51fe3970736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61e404d-a0fd-423f-8c3f-07f7b5b7240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61e404d-a0fd-423f-8c3f-07f7b5b7240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352ae158-af12-449e-8afa-044b8f019f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352ae158-af12-449e-8afa-044b8f019f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7916b67d-937f-4707-81af-de76c0416950', 'volume_name': 'volume-7916b67d-937f-4707-81af-de76c0416950', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bf9ba0-d52e-4786-9804-fe1238a110da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bf9ba0-d52e-4786-9804-fe1238a110da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25ac5dc-abd6-46c9-b0b8-d16b90259639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:02 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Volume 7916b67d-937f-4707-81af-de76c0416950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7916b67d-937f-4707-81af-de76c0416950', 'volume_size': 1} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-616004428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7916b67d-937f-4707-81af-de76c0416950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d1e453f44344e69e42dc638bf27a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:03Z,use_quota=True,user_id='c9313bcbd0de49e180b6c51fe3970736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Creating volume 7916b67d-937f-4707-81af-de76c0416950 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:02 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:02 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 1073741824 Apr 09 17:34:02 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:02 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606" returned: 0 in 0.974s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:02 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606 Apr 09 17:34:02 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:03 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff" returned: 0 in 0.851s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:03 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff Apr 09 17:34:03 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:03 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8832516b-ad50-4d9f-b53c-5b8516891606" returned: 0 in 0.763s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:03 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fc32dac5-63bf-4b3a-9350-1b833c0a9bff" returned: 0 in 0.690s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Lock "cinder-quobyte-8832516b-ad50-4d9f-b53c-5b8516891606" released by "delete_volume" :: held 1.837s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-quobyte-fc32dac5-63bf-4b3a-9350-1b833c0a9bff" released by "delete_volume" :: held 1.618s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Created reservations ['b2738580-4d98-4da6-b813-b92f152e6472', 'd6b62a91-14e0-4707-adbb-fa4d35f4b8b0', '1cfc7b67-90ca-4f82-906b-ae722abee5f6', '8b7c5a9b-0eb4-4f8d-ac2e-5b5450d46474'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Created reservations ['946649c2-1ad2-4897-aa3b-3f3056338cb1', 'a0e3ecf2-8125-4bd2-9d39-314d01961a7e', 'a3a70a67-adc6-4d41-9251-d9812e9a396a', '6c10c4a1-af43-4e59-aab9-9ba31adc57e2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:03 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:03 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:03 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:03 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:03 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 1073741824" returned: 0 in 1.086s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:04 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 Apr 09 17:34:04 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "cinder-9caed23d-afb8-4adc-9f22-a3303d24922d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-9caed23d-afb8-4adc-9f22-a3303d24922d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:04 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "cinder-quobyte-9caed23d-afb8-4adc-9f22-a3303d24922d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.702s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-quobyte-9caed23d-afb8-4adc-9f22-a3303d24922d" acquired by "delete_volume" :: waited 0.041s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Deleted volume successfully. Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ccbfb9-74fc-4a89-aa95-5f843f82d95f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-063db66f-c379-4b33-a61b-925a25e08a31 tempest-VolumesListAdminTestJSON-1478756090 None] Lock "cinder-8832516b-ad50-4d9f-b53c-5b8516891606-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:04 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.814s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Deleted volume successfully. Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-df5279d4-00ed-4c13-a90c-2daca3af7eea tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-fc32dac5-63bf-4b3a-9350-1b833c0a9bff-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:04 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d Apr 09 17:34:04 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:04 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950" returned: 0 in 0.892s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25ac5dc-abd6-46c9-b0b8-d16b90259639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7916b67d-937f-4707-81af-de76c0416950', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca05327d-e697-43c8-a7f4-6f1120ff1e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Volume volume-7916b67d-937f-4707-81af-de76c0416950 (7916b67d-937f-4707-81af-de76c0416950): created successfully Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca05327d-e697-43c8-a7f4-6f1120ff1e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Flow 'volume_create_manager' (6f786a00-a496-4591-9fcc-8151cb874b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3d350eaf-3539-42e3-a391-2f9a79f4338f tempest-VolumeQuotasAdminTestJSON-1990997849 None] Created volume successfully. Apr 09 17:34:05 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d" returned: 0 in 0.930s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:05 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d Apr 09 17:34:05 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:06 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9caed23d-afb8-4adc-9f22-a3303d24922d" returned: 0 in 0.559s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-quobyte-9caed23d-afb8-4adc-9f22-a3303d24922d" released by "delete_volume" :: held 1.533s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "cinder-7916b67d-937f-4707-81af-de76c0416950-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Created reservations ['d4b545f9-2f69-4d55-aaac-bc038db69391', '37b2012d-f693-4c86-b17c-a771209514df', '2b1a6b1d-1820-41a7-a430-d7a8c17e3681', '7a8fd1dd-e910-4eb5-8dfd-a696b274bb12'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "cinder-7916b67d-937f-4707-81af-de76c0416950-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:06 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "cinder-quobyte-7916b67d-937f-4707-81af-de76c0416950" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:06 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "cinder-quobyte-7916b67d-937f-4707-81af-de76c0416950" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b448b9-f1ae-4fdf-82db-494831517bef]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:06 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 Apr 09 17:34:06 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "cinder-51796e46-716e-4138-8f1a-ea082b732110-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-51796e46-716e-4138-8f1a-ea082b732110-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:07 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "cinder-quobyte-51796e46-716e-4138-8f1a-ea082b732110" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.716s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:07 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Deleted volume successfully. Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-quobyte-51796e46-716e-4138-8f1a-ea082b732110" acquired by "delete_volume" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-18b8a027-e3e6-4970-9f9d-ac1fa7e99558 tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-9caed23d-afb8-4adc-9f22-a3303d24922d-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adebcd2-1724-4c88-a18a-e7bdbac08924]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:07 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 Apr 09 17:34:07 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:07 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950" returned: 0 in 0.860s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:07 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950 Apr 09 17:34:07 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:07 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110" returned: 0 in 0.821s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:07 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110 Apr 09 17:34:07 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:07 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7916b67d-937f-4707-81af-de76c0416950" returned: 0 in 0.639s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "cinder-quobyte-7916b67d-937f-4707-81af-de76c0416950" released by "delete_volume" :: held 1.537s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Created reservations ['463c3ce1-5714-4c1c-8bab-0fe2424c8423', '0df8d2af-2260-4b08-ba14-cbef3ccc8a54', '5ee6e651-16af-4d0a-8335-e2b158c6e4fb', '3a79e576-65f3-49e1-9de8-4c2cca341e93'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:08 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:08 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:08 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:08 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:08 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-51796e46-716e-4138-8f1a-ea082b732110" returned: 0 in 0.682s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-quobyte-51796e46-716e-4138-8f1a-ea082b732110" released by "delete_volume" :: held 1.536s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Created reservations ['64b4cf8b-baaa-467d-8409-1cff279d5a6b', 'd15021d1-91a9-4d9f-9186-271d93c6dce9', 'b0f9c859-d5f5-4954-a7ba-96196091b709', '1e5668bb-3c87-4ede-b874-72139903fe77'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:08 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:08 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:08 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:08 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.820s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:08 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Deleted volume successfully. Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8acac6e0-8fe1-4b2f-833c-1b9ad96dd5f1 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "cinder-7916b67d-937f-4707-81af-de76c0416950-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Flow 'volume_create_manager' (e751b6a5-0379-4654-8413-460ed5346994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245c6751-1aeb-43b5-8313-8e201b3d0e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245c6751-1aeb-43b5-8313-8e201b3d0e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1861611473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a15f87e-cdbd-457c-bb70-9e642c219711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d1e453f44344e69e42dc638bf27a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:09Z,use_quota=True,user_id='c9313bcbd0de49e180b6c51fe3970736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d4d8a4-d8d3-40b5-8716-cf9dd708e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d4d8a4-d8d3-40b5-8716-cf9dd708e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecaa280-50ea-4ceb-8953-ffb751708745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecaa280-50ea-4ceb-8953-ffb751708745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a15f87e-cdbd-457c-bb70-9e642c219711', 'volume_name': 'volume-8a15f87e-cdbd-457c-bb70-9e642c219711', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e35d25-4572-4925-ba49-ad1e21eb2123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e35d25-4572-4925-ba49-ad1e21eb2123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3220a-eca1-49fc-9cbf-c39056603ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:09 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Volume 8a15f87e-cdbd-457c-bb70-9e642c219711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a15f87e-cdbd-457c-bb70-9e642c219711', 'volume_size': 1} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1861611473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a15f87e-cdbd-457c-bb70-9e642c219711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d1e453f44344e69e42dc638bf27a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:09Z,use_quota=True,user_id='c9313bcbd0de49e180b6c51fe3970736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Creating volume 8a15f87e-cdbd-457c-bb70-9e642c219711 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:09 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:09 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 1073741824 Apr 09 17:34:09 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:09 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.700s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:09 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Deleted volume successfully. Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-19f110cc-1c0b-4387-9652-225e480b761c tempest-VolumesListAdminTestJSON-2032903779 None] Lock "cinder-51796e46-716e-4138-8f1a-ea082b732110-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:09 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 1073741824" returned: 0 in 0.713s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:09 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 Apr 09 17:34:09 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:10 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711" returned: 0 in 0.570s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3220a-eca1-49fc-9cbf-c39056603ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a15f87e-cdbd-457c-bb70-9e642c219711', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd4eb5f-d9af-4d19-9b29-03e9cfb61a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Volume volume-8a15f87e-cdbd-457c-bb70-9e642c219711 (8a15f87e-cdbd-457c-bb70-9e642c219711): created successfully Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd4eb5f-d9af-4d19-9b29-03e9cfb61a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Flow 'volume_create_manager' (e751b6a5-0379-4654-8413-460ed5346994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b8a9fe6f-71fd-47e8-a320-b80184649836 tempest-VolumeQuotasAdminTestJSON-1990997849 None] Created volume successfully. Apr 09 17:34:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-e47db3e8-cb00-4757-9167-019670b0f6df req-ab4440ff-3336-46e1-b5ca-d05296fca472 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Terminate volume connection completed successfully. Apr 09 17:34:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-e47db3e8-cb00-4757-9167-019670b0f6df req-ab4440ff-3336-46e1-b5ca-d05296fca472 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Deleting attachment 5e95b577-b091-4980-a423-c36f7a84c181. {{(pid=82701) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Flow 'volume_create_manager' (43d62a9c-fd65-4496-94d9-631bbb71c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e04a819-5980-497c-9363-5a200d313aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e04a819-5980-497c-9363-5a200d313aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-461894477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af2663f-2748-4fab-8ff7-c1c141d26c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf1257e2d9e435e9f86b8fb783471b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:11Z,use_quota=True,user_id='b6ce590f6ff7452aa67da30517e4156c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df06ab3-09e8-42c1-b6ba-8c3c7d83f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df06ab3-09e8-42c1-b6ba-8c3c7d83f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75545db2-5567-4afe-8f75-1b573dc00483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75545db2-5567-4afe-8f75-1b573dc00483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af2663f-2748-4fab-8ff7-c1c141d26c86', 'volume_name': 'volume-4af2663f-2748-4fab-8ff7-c1c141d26c86', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb57c2a5-218f-45aa-ba98-48ef502c0578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb57c2a5-218f-45aa-ba98-48ef502c0578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d1a8ef-a715-4c42-811b-1994805739df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:11 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Volume 4af2663f-2748-4fab-8ff7-c1c141d26c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af2663f-2748-4fab-8ff7-c1c141d26c86', 'volume_size': 1} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-461894477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af2663f-2748-4fab-8ff7-c1c141d26c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdf1257e2d9e435e9f86b8fb783471b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:11Z,use_quota=True,user_id='b6ce590f6ff7452aa67da30517e4156c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Creating volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:11 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "cinder-4b169f18-4218-4750-8681-393f814c3f49-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:11 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 1073741824 Apr 09 17:34:11 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-4b169f18-4218-4750-8681-393f814c3f49-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "cinder-quobyte-4b169f18-4218-4750-8681-393f814c3f49" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-quobyte-4b169f18-4218-4750-8681-393f814c3f49" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fdbe6b-3953-4ad5-9e53-e016863e06b2]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:11 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:34:11 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c4fc6833-548d-42c5-9e09-d388a1a8ee8f tempest-VolumeQuotasAdminTestJSON-1690318408 None] Transfer volume completed successfully. Apr 09 17:34:11 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 1073741824" returned: 0 in 0.680s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:11 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 0 in 0.623s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:11 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 Apr 09 17:34:11 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:11 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:34:11 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:12 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 1 in 0.499s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:12 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86" returned: 0 in 0.539s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d1a8ef-a715-4c42-811b-1994805739df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af2663f-2748-4fab-8ff7-c1c141d26c86', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f72690-2b81-455a-9f25-b9ad3f500798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:12 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49 Apr 09 17:34:12 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:12 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Volume volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 (4af2663f-2748-4fab-8ff7-c1c141d26c86): created successfully Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f72690-2b81-455a-9f25-b9ad3f500798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Flow 'volume_create_manager' (43d62a9c-fd65-4496-94d9-631bbb71c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Acquiring lock "cinder-8a15f87e-cdbd-457c-bb70-9e642c219711-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:12 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-940f5cfc-788d-4432-921f-b9b558d6019e tempest-SnapshotsActionsTest-1636277492 None] Created volume successfully. Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Lock "cinder-8a15f87e-cdbd-457c-bb70-9e642c219711-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Acquiring lock "cinder-quobyte-8a15f87e-cdbd-457c-bb70-9e642c219711" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Lock "cinder-quobyte-8a15f87e-cdbd-457c-bb70-9e642c219711" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44c1708-a009-4f4f-b41a-89f206cdb6e7]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:12 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 Apr 09 17:34:12 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:12 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4b169f18-4218-4750-8681-393f814c3f49" returned: 0 in 0.610s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-quobyte-4b169f18-4218-4750-8681-393f814c3f49" released by "delete_volume" :: held 1.781s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.quota [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Created reservations ['95516dd2-c9ca-40e1-9974-084761adb054', 'ae4fb3de-cd3a-4954-bc3e-ea15896c6317', '44cd7726-99f5-4f08-b76e-8fdca0e1382d', 'ba06b9ab-a18a-4343-8573-96a6df7cc929'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:13 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:13 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:13 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711" returned: 0 in 0.627s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:13 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711 Apr 09 17:34:13 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Creating offline snapshot 7fdff81b-82f2-4718-92c9-742aa3820dc7 of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cddcec7-2a83-4541-9e0a-4c14af978a1a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:13 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 Apr 09 17:34:13 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:13 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.581s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.manager [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Deleted volume successfully. Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-e47db3e8-cb00-4757-9167-019670b0f6df req-6135ba93-6730-4124-9c1d-72e4c442839e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-4b169f18-4218-4750-8681-393f814c3f49-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:13 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8a15f87e-cdbd-457c-bb70-9e642c219711" returned: 0 in 0.562s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Lock "cinder-quobyte-8a15f87e-cdbd-457c-bb70-9e642c219711" released by "delete_volume" :: held 1.214s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Created reservations ['87799373-b4f9-4d25-bac2-a724a0ba7117', 'ac49d488-46d3-4da1-a4cc-a196668c279a', 'f172da79-61e7-4727-8162-e90ce9794dba', '8b6e05f1-db05-4281-98fe-b880d6ee36c8'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:13 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:13 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:13 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:13 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 1G Apr 09 17:34:13 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:14 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.571s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:14 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Deleted volume successfully. Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-746a5e91-178e-40c7-8fa5-45f34bdecd53 tempest-VolumeQuotasAdminTestJSON-1936847926 None] Lock "cinder-8a15f87e-cdbd-457c-bb70-9e642c219711-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:14 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 1G" returned: 0 in 0.724s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:14 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:14 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Flow 'volume_create_manager' (a87c5f0f-ceec-4af2-96d5-d990a5e08d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71115e5-a57c-495a-89a4-ffec1c0a0858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71115e5-a57c-495a-89a4-ffec1c0a0858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-38635822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f1f0cf-5bf5-460e-af97-402bc5a7d19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4043eda485704c0cba4330d71ce9664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:15Z,use_quota=True,user_id='78a0b244315f4c10b8e0d30a7f20063d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09f5f30-df85-4133-8b7f-7cbf0d65659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09f5f30-df85-4133-8b7f-7cbf0d65659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f26c25-5f9b-40d0-84dc-7ce6d3fe61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:14 devstack cinder-volume[82701]: DEBUG cinder.image.glance [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Creating Keystone auth plugin from conf {{(pid=82701) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f26c25-5f9b-40d0-84dc-7ce6d3fe61dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4f1f0cf-5bf5-460e-af97-402bc5a7d19c', 'volume_name': 'volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e25099-0486-43d8-a4fd-a4f0f759c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e25099-0486-43d8-a4fd-a4f0f759c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0abdf1-5976-4be7-b583-33c943a70735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:15 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Volume a4f1f0cf-5bf5-460e-af97-402bc5a7d19c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Trying to clone a4f1f0cf-5bf5-460e-af97-402bc5a7d19c from image e1c6f14c-6844-4aad-9551-57f242d39ddc at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]). {{(pid=82701) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 17:34:15 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Image download 20.69 MB at 20.69 MB/s Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[097f78f2-414b-409b-a224-3130f9ffcef1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:15 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.564s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:15 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 is being set with open permissions: ugo+rw Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:15 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:15 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:15 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD Apr 09 17:34:15 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:15 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.679s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:15 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:15 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc is fetched for user 78a0b244315f4c10b8e0d30a7f20063d. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 17:34:15 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info Apr 09 17:34:15 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6852b5-e045-4edd-9600-1631d3ae6a63]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:16 devstack sudo[86072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD Apr 09 17:34:16 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:16 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info" returned: 0 in 0.535s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:16 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info is being set with open permissions: ugo+rw Apr 09 17:34:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:16 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info Apr 09 17:34:16 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:16 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD" returned: 0 in 0.607s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:17 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.info" returned: 0 in 0.593s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.753s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-38635822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f1f0cf-5bf5-460e-af97-402bc5a7d19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4043eda485704c0cba4330d71ce9664a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:15Z,use_quota=True,user_id='78a0b244315f4c10b8e0d30a7f20063d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Creating volume a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:17 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:17 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c 1073741824 Apr 09 17:34:17 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3049a8ee-32e4-41cd-971e-c80dbb9f86ce tempest-SnapshotsActionsTest-1636277492 None] Create snapshot completed successfully Apr 09 17:34:17 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c 1073741824" returned: 0 in 0.638s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:17 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:17 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:18 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 0 in 0.506s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.300s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Creating offline snapshot 4ae85e55-bb23-405b-a84f-455aba4a050a of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea642b9-6ec3-4443-a9a3-06888193619e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Attempting download of e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume a4f1f0cf-5bf5-460e-af97-402bc5a7d19c. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f917ab8-9f35-4748-851a-80dd3b1e00f5]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:18 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:18 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:18 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz Apr 09 17:34:18 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:18 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.550s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:18 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a 1G Apr 09 17:34:18 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:18 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz" returned: 0 in 0.577s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:19 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz Apr 09 17:34:19 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:19 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a 1G" returned: 0 in 0.580s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:19 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a Apr 09 17:34:19 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:19 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz" returned: 1 in 0.604s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_smf4aanz' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[34814326-9089-402c-bbb3-d3c855f5132d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:19 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD Apr 09 17:34:19 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:19 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a" returned: 0 in 0.507s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:19 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a is being set with open permissions: ugo+rw Apr 09 17:34:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:20 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a Apr 09 17:34:20 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:20 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD" returned: 0 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:20 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] e1c6f14c-6844-4aad-9551-57f242d39ddc was qcow2, converting to raw {{(pid=82701) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 17:34:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:20 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:20 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:20 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a" returned: 0 in 0.531s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:20 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-22439f3b-cced-4185-b4e2-8b833e2d5bf5 tempest-SnapshotsActionsTest-1636277492 None] Create snapshot completed successfully Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-4ae85e55-bb23-405b-a84f-455aba4a050a-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-4ae85e55-bb23-405b-a84f-455aba4a050a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:21 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-4ae85e55-bb23-405b-a84f-455aba4a050a" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 0 in 1.118s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_23sx19b8devstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:34:21 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Converted 112.00 MB image at 100.05 MB/s Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4ae85e55-bb23-405b-a84f-455aba4a050a" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:21 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c 1G Apr 09 17:34:21 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Deleting offline snapshot 4ae85e55-bb23-405b-a84f-455aba4a050a of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] snapshot_file for this snap is: volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[545311b5-a60e-4bda-b0ce-0f45e13e1568]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:21 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a Apr 09 17:34:21 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:21 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c 1G" returned: 0 in 0.579s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ff387-570c-4f02-b1b1-facb6b8c7e62]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:21 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:21 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:22 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a" returned: 0 in 0.697s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[862cda8e-ece6-46ce-b69a-0accefa702c2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:22 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:22 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:22 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 0 in 0.662s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:22 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:22 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:22 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.653s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:22 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a Apr 09 17:34:22 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Flow 'volume_create_manager' (c55bf28d-097e-4a1a-a7a8-bf3634ce3ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e67cc5-f888-43bd-ba95-9f0a31ee50a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e67cc5-f888-43bd-ba95-9f0a31ee50a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-225894504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6460adad66d84f2aac8ed85c1ff33ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:23Z,use_quota=True,user_id='eee3616ea2944a67a06fd47e3e83505c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78e538b-13c5-4622-90c8-7fe23afac347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78e538b-13c5-4622-90c8-7fe23afac347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342874c7-c535-4cfe-89f5-5bc935e60ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342874c7-c535-4cfe-89f5-5bc935e60ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b', 'volume_name': 'volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91dea5d-b621-4d4e-acac-55981ad57999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91dea5d-b621-4d4e-acac-55981ad57999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ff7679-9e23-4a76-9e7f-30f6689aba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:23 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Volume f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b', 'volume_size': 1} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-225894504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6460adad66d84f2aac8ed85c1ff33ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:23Z,use_quota=True,user_id='eee3616ea2944a67a06fd47e3e83505c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Creating volume f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:23 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:23 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b 1073741824 Apr 09 17:34:23 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:23 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 1 in 0.562s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Downloaded image e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume a4f1f0cf-5bf5-460e-af97-402bc5a7d19c successfully. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc for user 78a0b244315f4c10b8e0d30a7f20063d is deleted. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Marking volume a4f1f0cf-5bf5-460e-af97-402bc5a7d19c as bootable. {{(pid=82701) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Copying metadata from image e1c6f14c-6844-4aad-9551-57f242d39ddc to a4f1f0cf-5bf5-460e-af97-402bc5a7d19c. {{(pid=82701) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Creating volume glance metadata for volume a4f1f0cf-5bf5-460e-af97-402bc5a7d19c backed by image e1c6f14c-6844-4aad-9551-57f242d39ddc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82701) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0abdf1-5976-4be7-b583-33c943a70735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd60f06-cc32-44ef-af78-284fe84020a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:23 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Volume volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c (a4f1f0cf-5bf5-460e-af97-402bc5a7d19c): created successfully Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd60f06-cc32-44ef-af78-284fe84020a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Flow 'volume_create_manager' (a87c5f0f-ceec-4af2-96d5-d990a5e08d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-51f9f332-4173-4158-a269-3e8c24575272 tempest-VolumesImageMetadata-1164425603 None] Created volume successfully. Apr 09 17:34:23 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a" returned: 0 in 0.636s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:23 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a Apr 09 17:34:23 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:23 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b 1073741824" returned: 0 in 0.583s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:23 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b Apr 09 17:34:23 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:23 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.4ae85e55-bb23-405b-a84f-455aba4a050a" returned: 0 in 0.451s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4ae85e55-bb23-405b-a84f-455aba4a050a" released by "_delete_snapshot" :: held 2.519s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" released by "delete_snapshot" :: held 2.559s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Created reservations ['184eb8e1-4691-4aa1-9817-a1a6e5a4d0a8', '663bfa39-2996-4a61-87f8-8b348cf915bf', '7ed95497-76aa-447f-8aee-331cff3df6be', 'ae6cd139-719e-4f05-9794-719f48ba5489'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Delete snapshot completed successfully. Apr 09 17:34:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-16234c38-bf15-4f87-8a7d-7fd290b75efb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-4ae85e55-bb23-405b-a84f-455aba4a050a-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:24 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" returned: 0 in 0.438s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ff7679-9e23-4a76-9e7f-30f6689aba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef0a7c-fd74-48ce-9178-a1b1a3a4b989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:24 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Volume volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b (f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b): created successfully Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef0a7c-fd74-48ce-9178-a1b1a3a4b989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Flow 'volume_create_manager' (c55bf28d-097e-4a1a-a7a8-bf3634ce3ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:24 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f34d6017-f263-4e75-b380-b5401c5e153d tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Created volume successfully. Apr 09 17:34:24 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-cef62dc3-7490-4fbb-a3d8-7f74f67b5e8e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Terminate volume connection completed successfully. Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-cef62dc3-7490-4fbb-a3d8-7f74f67b5e8e tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Deleting attachment 0ce4314f-254d-4df0-bd87-5528aa39432f. {{(pid=82701) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Acquiring lock "cinder-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Lock "cinder-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Acquiring lock "cinder-quobyte-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Lock "cinder-quobyte-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20de6f-25a6-4099-8a95-b0a31189d6ec]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:24 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:24 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Creating offline snapshot b393d195-fcba-478e-8945-6ea4eb87d3ef of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b2a25-c942-45dd-8092-4206776f407e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:24 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:24 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "cinder-987fbe20-e7d4-466d-ac54-1e83bf64df59-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-987fbe20-e7d4-466d-ac54-1e83bf64df59-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "cinder-quobyte-987fbe20-e7d4-466d-ac54-1e83bf64df59" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-quobyte-987fbe20-e7d4-466d-ac54-1e83bf64df59" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc0f9e8-41b0-4fbd-8733-f95db2e1211f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:25 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 Apr 09 17:34:25 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:25 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 0 in 0.558s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:25 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:25 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:25 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.540s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:25 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef 1G Apr 09 17:34:25 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:25 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59" returned: 0 in 0.606s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:25 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59 Apr 09 17:34:25 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:25 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 1 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:25 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c Apr 09 17:34:25 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:25 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef 1G" returned: 0 in 0.532s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:25 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef Apr 09 17:34:25 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:26 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-987fbe20-e7d4-466d-ac54-1e83bf64df59" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-quobyte-987fbe20-e7d4-466d-ac54-1e83bf64df59" released by "delete_volume" :: held 1.115s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.quota [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Created reservations ['a52b7756-5d82-465f-9aa7-714eeec48ee3', '5d197f6f-18b2-4b70-a1ae-424edd7a32d3', '0746ecd0-939d-4e3c-a0d2-8fea2b1e5dc5', '3411febc-c70d-4258-bcbe-646d3b08df5c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:26 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:26 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:26 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" returned: 0 in 0.463s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Lock "cinder-quobyte-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c" released by "delete_volume" :: held 1.628s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Created reservations ['d5b34e5f-0519-45b0-8ff2-b3df0221f063', '87c00d3f-6bd6-401d-a8c9-baa10b1e278f', 'd87b41f3-96cb-499b-990d-ceff63673d6f', '29ba916e-afec-4ca9-b99d-970af9a7c0c1'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:26 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef" returned: 0 in 0.483s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:26 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef is being set with open permissions: ugo+rw Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:26 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:26 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:26 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef Apr 09 17:34:26 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:26 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.443s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.manager [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Deleted volume successfully. Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [req-8e87c709-ffde-48bf-ae38-45b2acf9834c req-6238b25b-f2af-452a-b012-e4216941fc92 tempest-ServerBootFromVolumeStableRescueTest-230694727 None] Lock "cinder-987fbe20-e7d4-466d-ac54-1e83bf64df59-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:26 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.450s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Deleted volume successfully. Apr 09 17:34:26 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.621s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d45c1d3b-7c50-4533-9368-3ed31d4352d3 tempest-VolumesImageMetadata-1164425603 None] Lock "cinder-a4f1f0cf-5bf5-460e-af97-402bc5a7d19c-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Creating offline snapshot 3f917f08-22b8-4452-b8ad-2ed67c3ea93d of volume f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:34:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-334dcf6f-b0d2-4afb-9be9-0d78aa740592 tempest-SnapshotsActionsTest-1636277492 None] Create snapshot completed successfully Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5045b02d-ff5f-4227-b4a6-930415e82e86]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:26 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b Apr 09 17:34:26 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:27 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" returned: 0 in 0.538s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:27 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d 1G Apr 09 17:34:27 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:28 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d 1G" returned: 0 in 0.610s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:28 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d Apr 09 17:34:28 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-b393d195-fcba-478e-8945-6ea4eb87d3ef-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-b393d195-fcba-478e-8945-6ea4eb87d3ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-b393d195-fcba-478e-8945-6ea4eb87d3ef" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-b393d195-fcba-478e-8945-6ea4eb87d3ef" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Deleting offline snapshot b393d195-fcba-478e-8945-6ea4eb87d3ef of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] snapshot_file for this snap is: volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d73a30a-9df1-41e3-9338-8c25f1e5f680]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:28 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef Apr 09 17:34:28 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:28 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d" returned: 0 in 0.610s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:28 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d is being set with open permissions: ugo+rw Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:28 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d Apr 09 17:34:28 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:28 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef" returned: 0 in 0.554s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f50caf-3b03-47f1-b2a4-5f340a2869e4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:28 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:28 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:29 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d" returned: 0 in 0.483s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:29 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info Apr 09 17:34:29 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:29 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:29 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef Apr 09 17:34:29 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:29 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info" returned: 0 in 0.734s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:29 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info is being set with open permissions: ugo+rw Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:29 devstack sudo[86324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info Apr 09 17:34:29 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:29 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:29 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef Apr 09 17:34:29 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:30 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.info" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.489s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cd83235e-18b7-40af-9ef1-7d456bfc1adb tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Create snapshot completed successfully Apr 09 17:34:30 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.b393d195-fcba-478e-8945-6ea4eb87d3ef" returned: 0 in 0.471s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-b393d195-fcba-478e-8945-6ea4eb87d3ef" released by "_delete_snapshot" :: held 2.277s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" released by "delete_snapshot" :: held 2.292s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Created reservations ['bcd72b5b-17aa-4779-92e9-dbf37cd5f591', '202e3fd7-e672-48ea-ad36-2c1d04da9d11', '058e075d-63cd-44c3-9818-828b547a0312', '389e121a-92e9-4ad1-9fb9-7ad81f642197'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Delete snapshot completed successfully. Apr 09 17:34:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-84a3869f-f872-4f5b-97cc-68cd84195f44 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-b393d195-fcba-478e-8945-6ea4eb87d3ef-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Flow 'volume_create_manager' (2dde38e6-118a-4f21-9dd9-615a9d629155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c37354-9fb5-4163-a1d7-16c1c50edeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c37354-9fb5-4163-a1d7-16c1c50edeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-187659476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aff948-ff06-4d62-9df7-4d6002b324c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f41b65cb742b1ab44cf6bebd36b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:31Z,use_quota=True,user_id='c61c3a71de9e4efaa4204ceefd8d35a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad3208e-8d74-42dd-80ff-e0cbe14b6710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad3208e-8d74-42dd-80ff-e0cbe14b6710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c224165-5263-42c6-b815-a3bd49783c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c224165-5263-42c6-b815-a3bd49783c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aff948-ff06-4d62-9df7-4d6002b324c3', 'volume_name': 'volume-d0aff948-ff06-4d62-9df7-4d6002b324c3', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e50c47f-b549-45ff-bf9b-3329002dd096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e50c47f-b549-45ff-bf9b-3329002dd096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de1750d-b283-4f2a-9d78-46d0c2bf92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:31 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Volume d0aff948-ff06-4d62-9df7-4d6002b324c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aff948-ff06-4d62-9df7-4d6002b324c3', 'volume_size': 1} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-187659476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aff948-ff06-4d62-9df7-4d6002b324c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f41b65cb742b1ab44cf6bebd36b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:31Z,use_quota=True,user_id='c61c3a71de9e4efaa4204ceefd8d35a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Creating volume d0aff948-ff06-4d62-9df7-4d6002b324c3 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:31 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:31 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 1073741824 Apr 09 17:34:31 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "cinder-3f917f08-22b8-4452-b8ad-2ed67c3ea93d-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-3f917f08-22b8-4452-b8ad-2ed67c3ea93d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "cinder-quobyte-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-quobyte-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "cinder-quobyte-3f917f08-22b8-4452-b8ad-2ed67c3ea93d" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-quobyte-3f917f08-22b8-4452-b8ad-2ed67c3ea93d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Deleting offline snapshot 3f917f08-22b8-4452-b8ad-2ed67c3ea93d of volume f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] snapshot_file for this snap is: volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f042d4f-3ddd-4677-8c78-cb8e7fa2313f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:31 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d Apr 09 17:34:31 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:31 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 1073741824" returned: 0 in 0.548s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:31 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 Apr 09 17:34:31 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:32 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fa176-295c-4478-880d-c024d5a6a58e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:32 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3" returned: 0 in 0.417s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.856s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de1750d-b283-4f2a-9d78-46d0c2bf92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aff948-ff06-4d62-9df7-4d6002b324c3', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad234a1-a51c-4e2c-8c8a-55e9fe6b16b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Creating offline snapshot d4a55ada-9660-4503-8f8a-99736eb7cc3c of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:34:32 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Volume volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 (d0aff948-ff06-4d62-9df7-4d6002b324c3): created successfully Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad234a1-a51c-4e2c-8c8a-55e9fe6b16b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Flow 'volume_create_manager' (2dde38e6-118a-4f21-9dd9-615a9d629155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb1135-3086-4991-9eba-3c601f99544a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:32 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b Apr 09 17:34:32 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:32 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a96bfd97-1d94-4654-869b-525b3fa9654b tempest-VolumesTransfersTest-53397487 None] Created volume successfully. Apr 09 17:34:32 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:32 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:32 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" returned: 0 in 0.525s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:32 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d Apr 09 17:34:32 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:32 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.513s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:32 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c 1G Apr 09 17:34:32 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:33 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d" returned: 0 in 0.502s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:33 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d Apr 09 17:34:33 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:33 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c 1G" returned: 0 in 0.540s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:33 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c Apr 09 17:34:33 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1e37486b-903e-42a2-9271-cfffd29d9fac tempest-VolumesTransfersTest-201714483 None] Transfer volume completed successfully. Apr 09 17:34:33 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b.3f917f08-22b8-4452-b8ad-2ed67c3ea93d" returned: 0 in 0.515s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-quobyte-3f917f08-22b8-4452-b8ad-2ed67c3ea93d" released by "_delete_snapshot" :: held 2.100s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-quobyte-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" released by "delete_snapshot" :: held 2.116s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Created reservations ['afa05cdc-cd30-422e-bf84-46c9c132d1da', 'cce36391-ef4a-4eaf-ab19-0dcb72ae9b5a', 'b6b9f280-ad76-4c6e-a65f-ba5f3934f232', 'a433d3fd-28bb-42b0-8172-35941dc7ec56'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:33 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c" returned: 0 in 0.482s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:33 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c is being set with open permissions: ugo+rw Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:33 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c Apr 09 17:34:33 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Delete snapshot completed successfully. Apr 09 17:34:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-537fdca7-1b54-4b33-b5fd-e9335eaf1da9 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-3f917f08-22b8-4452-b8ad-2ed67c3ea93d-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:34 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:34 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4e656e3f-a62e-4744-81cc-4680fe23b699 tempest-SnapshotsActionsTest-1636277492 None] Create snapshot completed successfully Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Acquiring lock "cinder-d0aff948-ff06-4d62-9df7-4d6002b324c3-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-d0aff948-ff06-4d62-9df7-4d6002b324c3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Acquiring lock "cinder-quobyte-d0aff948-ff06-4d62-9df7-4d6002b324c3" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-quobyte-d0aff948-ff06-4d62-9df7-4d6002b324c3" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3083649f-62cf-417a-8785-242c207ff9a0]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-d4a55ada-9660-4503-8f8a-99736eb7cc3c-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-d4a55ada-9660-4503-8f8a-99736eb7cc3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-d4a55ada-9660-4503-8f8a-99736eb7cc3c" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:34 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 Apr 09 17:34:34 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-d4a55ada-9660-4503-8f8a-99736eb7cc3c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Deleting offline snapshot d4a55ada-9660-4503-8f8a-99736eb7cc3c of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] snapshot_file for this snap is: volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd5b83-320f-4102-9014-511cdb15b8a4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:34 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c Apr 09 17:34:34 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "cinder-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "cinder-quobyte-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-quobyte-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df4f6fb-37fe-4bb4-917d-eb5eb734b7b6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:35 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b Apr 09 17:34:35 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:35 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:35 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3 Apr 09 17:34:35 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:35 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c" returned: 0 in 0.534s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6f1ccc-d0a1-42c6-a435-4cf6d75c12d1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:35 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:35 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:35 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" returned: 0 in 0.519s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:35 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b Apr 09 17:34:35 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:35 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d0aff948-ff06-4d62-9df7-4d6002b324c3" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-quobyte-d0aff948-ff06-4d62-9df7-4d6002b324c3" released by "delete_volume" :: held 1.074s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Created reservations ['dde796f5-d862-473a-b867-7beac30a2850', 'a5bcc9a2-eda7-410c-b4db-f524e17c95c3', '5276ae6d-6711-430e-a8e0-2c209fc73132', 'a2c6648a-4ceb-4465-81ed-688b3912f7b3'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:35 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:35 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:35 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.627s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:35 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c Apr 09 17:34:35 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:36 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" returned: 0 in 0.520s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-quobyte-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b" released by "delete_volume" :: held 1.071s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Created reservations ['d395924f-c319-4866-a3de-19a0a037325c', '363f5a50-2a15-479c-8641-cd779a4e393a', '315e24c0-4ced-43ec-97fc-b72b60ce3767', '84d26659-14b0-4fb6-aa89-05f086f579b6'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:36 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:36 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:36 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.512s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Deleted volume successfully. Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e7ea7faf-4382-4b9a-9bb2-0d347b5da4ba tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-d0aff948-ff06-4d62-9df7-4d6002b324c3-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:36 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c" returned: 0 in 0.558s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:36 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c Apr 09 17:34:36 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:36 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.496s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Deleted volume successfully. Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e172506c-b722-43a4-b693-95c66468be67 tempest-VolumeSnapshotQuotasNegativeTestJSON-28737187 None] Lock "cinder-f443a4ea-6d64-4c1c-bec4-9b2b11a1cd3b-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:36 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.d4a55ada-9660-4503-8f8a-99736eb7cc3c" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-d4a55ada-9660-4503-8f8a-99736eb7cc3c" released by "_delete_snapshot" :: held 2.265s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" released by "delete_snapshot" :: held 2.286s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Created reservations ['8e948dfd-af1e-4985-b787-1228f0d971cc', '6a6653ef-731b-4052-be7e-5a660fded64a', 'ef4fec7e-6776-491d-ae16-a063812c1991', 'dc9f7fcd-440f-4d4a-ad6b-8944d7e732f2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Flow 'volume_create_manager' (a559977c-4eeb-4b82-a8c9-3e23b95cc47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82eb309-da50-4333-8bdd-1dbf6eaf2659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:37 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Delete snapshot completed successfully. Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82eb309-da50-4333-8bdd-1dbf6eaf2659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1790778236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d92e485-accf-4b3f-a861-c7fb20dbe161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f41b65cb742b1ab44cf6bebd36b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:37Z,use_quota=True,user_id='c61c3a71de9e4efaa4204ceefd8d35a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc736968-8ccf-48f1-a194-e1691c5ad3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc736968-8ccf-48f1-a194-e1691c5ad3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e368a7-7b59-4c02-988e-b7dba9d831ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e368a7-7b59-4c02-988e-b7dba9d831ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d92e485-accf-4b3f-a861-c7fb20dbe161', 'volume_name': 'volume-9d92e485-accf-4b3f-a861-c7fb20dbe161', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820ea3c6-195e-429c-929a-0cbd1a273a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820ea3c6-195e-429c-929a-0cbd1a273a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1c6b83-63f1-4102-9945-d8c2b86a07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:37 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Volume 9d92e485-accf-4b3f-a861-c7fb20dbe161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d92e485-accf-4b3f-a861-c7fb20dbe161', 'volume_size': 1} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1790778236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d92e485-accf-4b3f-a861-c7fb20dbe161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f41b65cb742b1ab44cf6bebd36b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:37Z,use_quota=True,user_id='c61c3a71de9e4efaa4204ceefd8d35a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Creating volume 9d92e485-accf-4b3f-a861-c7fb20dbe161 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:37 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32e5e595-6968-4929-b1a6-e9f635f7bfdb tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-d4a55ada-9660-4503-8f8a-99736eb7cc3c-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:37 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 1073741824 Apr 09 17:34:37 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:37 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 1073741824" returned: 0 in 0.613s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:37 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 Apr 09 17:34:37 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:38 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161" returned: 0 in 0.615s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.312s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1c6b83-63f1-4102-9945-d8c2b86a07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d92e485-accf-4b3f-a861-c7fb20dbe161', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12928bc7-bd66-4032-8388-b785d85b7648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Creating offline snapshot 184faa29-2692-4f69-bc81-2243990dce98 of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:34:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Volume volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 (9d92e485-accf-4b3f-a861-c7fb20dbe161): created successfully Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12928bc7-bd66-4032-8388-b785d85b7648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Flow 'volume_create_manager' (a559977c-4eeb-4b82-a8c9-3e23b95cc47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1588f3-948f-4a41-a713-e621a7f1a949]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ede59abd-b3ac-4264-9401-640f201f5707 tempest-VolumesTransfersTest-53397487 None] Created volume successfully. Apr 09 17:34:38 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:38 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:39 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.633s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:39 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 1G Apr 09 17:34:39 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Acquiring lock "cinder-9d92e485-accf-4b3f-a861-c7fb20dbe161-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-9d92e485-accf-4b3f-a861-c7fb20dbe161-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:UPDATE=243,cinder:SELECT=190,cinder:INSERT=60,cinder:DELETE=14 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=189,cinder:UPDATE=189,cinder:INSERT=53,cinder:DELETE=16 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Acquiring lock "cinder-quobyte-9d92e485-accf-4b3f-a861-c7fb20dbe161" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-quobyte-9d92e485-accf-4b3f-a861-c7fb20dbe161" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[456ee61f-12de-4a7f-b354-04b41155f536]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:39 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 Apr 09 17:34:39 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:39 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 1G" returned: 0 in 0.709s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:39 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 Apr 09 17:34:39 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:40 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161" returned: 0 in 0.676s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:40 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161 Apr 09 17:34:40 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:40 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:40 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 is being set with open permissions: ugo+rw Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:40 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 Apr 09 17:34:40 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:40 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9d92e485-accf-4b3f-a861-c7fb20dbe161" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-quobyte-9d92e485-accf-4b3f-a861-c7fb20dbe161" released by "delete_volume" :: held 1.214s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Created reservations ['15e0cf8d-de5a-4eec-ae6b-4e2ef948a83a', '0ccff8a9-7ce7-49e7-96af-283c57d5283b', '6e618245-3cc5-440f-b921-a75251c0afdb', 'fda04fba-ad3f-4bd6-acaf-dc9a57555622'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:40 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98" returned: 0 in 0.520s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:40 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cd516dc9-75fc-47c4-9385-241b754ab386 tempest-SnapshotsActionsTest-1636277492 None] Create snapshot completed successfully Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:40 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:40 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-184faa29-2692-4f69-bc81-2243990dce98-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-184faa29-2692-4f69-bc81-2243990dce98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Acquiring lock "cinder-quobyte-184faa29-2692-4f69-bc81-2243990dce98" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-184faa29-2692-4f69-bc81-2243990dce98" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Deleting offline snapshot 184faa29-2692-4f69-bc81-2243990dce98 of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:34:41 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] snapshot_file for this snap is: volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f57023-221e-4cb1-befc-765115a6ff45]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Deleted volume successfully. Apr 09 17:34:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5c833a6e-4114-4bf2-b9ab-f2dbb61e4ea2 tempest-VolumesTransfersTest-2070137231 None] Lock "cinder-9d92e485-accf-4b3f-a861-c7fb20dbe161-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:41 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 Apr 09 17:34:41 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:42 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98" returned: 0 in 0.843s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5429ab8b-edb1-41ad-92e6-4aa1de5c9989]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:42 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:42 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:42 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.630s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:42 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 Apr 09 17:34:42 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:43 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98" returned: 0 in 0.640s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:43 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98 Apr 09 17:34:43 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:44 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.184faa29-2692-4f69-bc81-2243990dce98" returned: 0 in 0.535s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-184faa29-2692-4f69-bc81-2243990dce98" released by "_delete_snapshot" :: held 2.705s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" released by "delete_snapshot" :: held 2.719s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Created reservations ['01305ca8-9dfe-4c53-9e62-8dcaf386d78a', '2eb7612e-c86d-4f4f-8b76-7847348593a4', '80bc2e25-185e-4276-b372-9e8a7c39214a', '9cd4c0b4-9d80-4181-bf9f-73ee8a03cdf2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:44 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Delete snapshot completed successfully. Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3a6b68e6-c332-4f9f-8420-42761f352d00 tempest-SnapshotsActionsTest-1670121140 None] Lock "cinder-184faa29-2692-4f69-bc81-2243990dce98-delete_snapshot" released by "delete_snapshot" :: held 2.893s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "cinder-7fdff81b-82f2-4718-92c9-742aa3820dc7-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-7fdff81b-82f2-4718-92c9-742aa3820dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "cinder-quobyte-7fdff81b-82f2-4718-92c9-742aa3820dc7" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-quobyte-7fdff81b-82f2-4718-92c9-742aa3820dc7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Deleting offline snapshot 7fdff81b-82f2-4718-92c9-742aa3820dc7 of volume 4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] snapshot_file for this snap is: volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddaa1d6-f1bc-4bb9-adac-addea4db4076]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Flow 'volume_create_manager' (0a690286-114e-4002-9511-94f8dd24a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2544e0bf-3536-4ebf-ab12-6377be1f73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:45 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:45 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2544e0bf-3536-4ebf-ab12-6377be1f73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1872178956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e5273d-1ff0-46f1-bd56-8a5aab3d166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20e2150e4f34288a3a9a870031afdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:45Z,use_quota=True,user_id='af3160cbd4cb4b85876a7c77016911f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d930ed-8ec7-4d2e-ac4c-3f2d094b3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d930ed-8ec7-4d2e-ac4c-3f2d094b3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b267731-6906-4312-82f7-21cafee0e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b267731-6906-4312-82f7-21cafee0e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e5273d-1ff0-46f1-bd56-8a5aab3d166b', 'volume_name': 'volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5617d61-7a1d-4a60-a833-c915c856a340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5617d61-7a1d-4a60-a833-c915c856a340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7db968-6d2f-4f51-bf3c-f982cd48d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:45 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Volume 33e5273d-1ff0-46f1-bd56-8a5aab3d166b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b', 'volume_size': 1} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1872178956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e5273d-1ff0-46f1-bd56-8a5aab3d166b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e20e2150e4f34288a3a9a870031afdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:45Z,use_quota=True,user_id='af3160cbd4cb4b85876a7c77016911f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Creating volume 33e5273d-1ff0-46f1-bd56-8a5aab3d166b {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:45 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:45 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b 1073741824 Apr 09 17:34:45 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:45 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.830s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af2663f-2748-4fab-8ff7-c1c141d26c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b00e1b-5df6-41c5-b857-3766ed191af9]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:45 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b 1073741824" returned: 0 in 0.727s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:45 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b Apr 09 17:34:45 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:46 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 Apr 09 17:34:46 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:46 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b" returned: 0 in 0.613s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7db968-6d2f-4f51-bf3c-f982cd48d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b8b4ac-a4f8-41e4-827d-8ffb7c6b2cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:46 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Volume volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b (33e5273d-1ff0-46f1-bd56-8a5aab3d166b): created successfully Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b8b4ac-a4f8-41e4-827d-8ffb7c6b2cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Flow 'volume_create_manager' (0a690286-114e-4002-9511-94f8dd24a085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7cfd769c-5245-4118-9c91-5ed1572b4281 tempest-VolumesMetadataTest-283390642 None] Created volume successfully. Apr 09 17:34:46 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86" returned: 0 in 0.722s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:46 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:46 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:47 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.605s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:47 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7 Apr 09 17:34:47 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:47 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86.7fdff81b-82f2-4718-92c9-742aa3820dc7" returned: 0 in 0.784s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-quobyte-7fdff81b-82f2-4718-92c9-742aa3820dc7" released by "_delete_snapshot" :: held 3.052s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" released by "delete_snapshot" :: held 3.072s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Acquiring lock "cinder-33e5273d-1ff0-46f1-bd56-8a5aab3d166b-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Lock "cinder-33e5273d-1ff0-46f1-bd56-8a5aab3d166b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Acquiring lock "cinder-quobyte-33e5273d-1ff0-46f1-bd56-8a5aab3d166b" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Created reservations ['a56fa9a8-cb80-43ae-bfbd-e0139749a624', 'fe45ce13-d9f9-44f0-aebc-8803ff7773fa', 'c34380c7-e501-4c63-9e82-70d7417d7939', '9d1ffab7-7fdf-449c-b9a9-9410a6fd71c8'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Lock "cinder-quobyte-33e5273d-1ff0-46f1-bd56-8a5aab3d166b" acquired by "delete_volume" :: waited 0.029s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bdfdd7-684d-4e46-8b64-258ac1f59a31]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Delete snapshot completed successfully. Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1b9bcb7-db52-4072-80aa-b0e32c562031 tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-7fdff81b-82f2-4718-92c9-742aa3820dc7-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:48 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b Apr 09 17:34:48 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Flow 'volume_create_manager' (836e8ec1-972a-4920-97f1-c4cb1a0e308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f7adb6-ce41-4a2a-a4a7-0badec25d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f7adb6-ce41-4a2a-a4a7-0badec25d952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-288510943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ba3846-bef8-4377-8c87-a5dd28327c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39e0ccf98f40778d3c308b6414c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:48Z,use_quota=True,user_id='9bc2e804ee5c4e52bfbcfccde44240aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09debed-feed-47af-98be-09ea88a304e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09debed-feed-47af-98be-09ea88a304e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08106ba4-81b0-4d06-97d0-270161f5b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08106ba4-81b0-4d06-97d0-270161f5b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ba3846-bef8-4377-8c87-a5dd28327c54', 'volume_name': 'volume-c3ba3846-bef8-4377-8c87-a5dd28327c54', 'volume_size': 2}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9445d3-18a8-4437-a9ae-62188fdcdafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9445d3-18a8-4437-a9ae-62188fdcdafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db2ed43-37b4-43c5-a081-224bcf18dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:48 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Volume c3ba3846-bef8-4377-8c87-a5dd28327c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ba3846-bef8-4377-8c87-a5dd28327c54', 'volume_size': 2} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-288510943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ba3846-bef8-4377-8c87-a5dd28327c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39e0ccf98f40778d3c308b6414c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:48Z,use_quota=True,user_id='9bc2e804ee5c4e52bfbcfccde44240aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Creating volume c3ba3846-bef8-4377-8c87-a5dd28327c54 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:48 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 2147483648 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:48 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 2147483648 Apr 09 17:34:48 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:48 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b" returned: 0 in 0.559s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:48 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b Apr 09 17:34:48 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:49 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 2147483648" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:49 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 Apr 09 17:34:49 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:49 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "cinder-4af2663f-2748-4fab-8ff7-c1c141d26c86-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33e5273d-1ff0-46f1-bd56-8a5aab3d166b" returned: 0 in 0.518s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Lock "cinder-quobyte-33e5273d-1ff0-46f1-bd56-8a5aab3d166b" released by "delete_volume" :: held 1.108s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-4af2663f-2748-4fab-8ff7-c1c141d26c86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" acquired by "delete_volume" :: waited 0.028s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0746371-7c30-4341-bd33-2729c4c360ae]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Created reservations ['535c2c1e-4cc9-48ee-89d3-edbca2d5f608', 'e9508a7f-97ba-4ef1-b748-2d18fe5aef3a', '64b64cca-cc88-435c-8fb9-f3e59b04fdb9', 'f208ee17-4bbf-4a7f-a282-cd80c993cb3f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:49 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 Apr 09 17:34:49 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:49 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:49 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:49 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54" returned: 0 in 0.516s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db2ed43-37b4-43c5-a081-224bcf18dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ba3846-bef8-4377-8c87-a5dd28327c54', 'volume_size': 2}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92867abb-3050-4adb-a585-b2b4d321f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:49 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Volume volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 (c3ba3846-bef8-4377-8c87-a5dd28327c54): created successfully Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92867abb-3050-4adb-a585-b2b4d321f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Flow 'volume_create_manager' (836e8ec1-972a-4920-97f1-c4cb1a0e308d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-19c93fe9-a171-4f55-a210-0f940ff90ea2 tempest-VolumesCloneNegativeTest-767179232 None] Created volume successfully. Apr 09 17:34:49 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86" returned: 0 in 0.522s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:49 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86 Apr 09 17:34:49 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:49 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.440s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Deleted volume successfully. Apr 09 17:34:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e01ac88c-c479-40bb-80bd-3760c1efe0f3 tempest-VolumesMetadataTest-283390642 None] Lock "cinder-33e5273d-1ff0-46f1-bd56-8a5aab3d166b-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:50 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4af2663f-2748-4fab-8ff7-c1c141d26c86" returned: 0 in 0.441s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-quobyte-4af2663f-2748-4fab-8ff7-c1c141d26c86" released by "delete_volume" :: held 1.002s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Created reservations ['282cc800-c7e0-4951-bcc4-0b64b022ed06', '30f68f24-bf11-4bed-9174-41f37e65bd5b', '8a4c6ddd-2c59-4c9d-bf5d-48cfbc644628', '8dbd415c-ebcb-4694-ba6e-ace437a1a82e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:50 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:50 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:50 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Acquiring lock "cinder-c3ba3846-bef8-4377-8c87-a5dd28327c54-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:50 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Deleted volume successfully. Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Lock "cinder-c3ba3846-bef8-4377-8c87-a5dd28327c54-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-2d8f9a61-9e54-4842-9759-f5b1310df0af tempest-SnapshotsActionsTest-1636277492 None] Lock "cinder-4af2663f-2748-4fab-8ff7-c1c141d26c86-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Acquiring lock "cinder-quobyte-c3ba3846-bef8-4377-8c87-a5dd28327c54" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Lock "cinder-quobyte-c3ba3846-bef8-4377-8c87-a5dd28327c54" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c690b98-ffe3-4be2-8a4a-5821d1eb0cae]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:50 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 Apr 09 17:34:51 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:51 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54" returned: 0 in 0.604s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:51 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54 Apr 09 17:34:51 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:52 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3ba3846-bef8-4377-8c87-a5dd28327c54" returned: 0 in 0.594s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Lock "cinder-quobyte-c3ba3846-bef8-4377-8c87-a5dd28327c54" released by "delete_volume" :: held 1.231s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Created reservations ['895f4f2b-5f82-467e-83bc-f799ae94730c', '6755651e-51c6-46b3-bb4e-802600cfcc62', '84f52e14-f4b3-4fb8-8b43-41dc89889a2f', '6b2adbfb-57ea-4fc5-b878-9db8ce2d7dd2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:52 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:34:52 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:52 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.581s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:34:52 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Deleted volume successfully. Apr 09 17:34:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3384520f-49f1-45d3-8f2a-3a87258d5bcc tempest-VolumesCloneNegativeTest-767179232 None] Lock "cinder-c3ba3846-bef8-4377-8c87-a5dd28327c54-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Flow 'volume_create_manager' (655f1449-fcfe-41d8-b2dc-fba331e4557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43adc59e-3488-4673-a9cb-9c05a587444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43adc59e-3488-4673-a9cb-9c05a587444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-279486539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54756d5-760d-4db9-bbd8-6c42053bea3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551acea6d45f4cb1aa1cc2bb36938ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:56Z,use_quota=True,user_id='a69b478f75104a288aabcbb454578ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e3a5f-bbcb-45dc-9ab9-4366b01bcd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e3a5f-bbcb-45dc-9ab9-4366b01bcd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a032e26-b7c9-44e2-9d51-894f913841ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.image.glance [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Creating Keystone auth plugin from conf {{(pid=82701) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a032e26-b7c9-44e2-9d51-894f913841ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f54756d5-760d-4db9-bbd8-6c42053bea3c', 'volume_name': 'volume-f54756d5-760d-4db9-bbd8-6c42053bea3c', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d266d5-aca5-4957-816f-c04282de5e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d266d5-aca5-4957-816f-c04282de5e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f28dc64-1a89-4508-9f34-020c3e079467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:56 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Volume f54756d5-760d-4db9-bbd8-6c42053bea3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f54756d5-760d-4db9-bbd8-6c42053bea3c', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Trying to clone f54756d5-760d-4db9-bbd8-6c42053bea3c from image e1c6f14c-6844-4aad-9551-57f242d39ddc at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]). {{(pid=82701) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 17:34:56 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 17:34:56 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Image download 20.69 MB at 20.69 MB/s Apr 09 17:34:57 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[08655068-be50-4b50-a5a3-cd0ca0a59c1c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:57 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD Apr 09 17:34:57 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:57 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:57 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc is fetched for user a69b478f75104a288aabcbb454578ecc. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 17:34:57 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c4e50-79a2-4470-af9d-78b07734e01e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:57 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD Apr 09 17:34:57 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:58 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD" returned: 0 in 0.616s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-279486539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54756d5-760d-4db9-bbd8-6c42053bea3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551acea6d45f4cb1aa1cc2bb36938ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:34:56Z,use_quota=True,user_id='a69b478f75104a288aabcbb454578ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Creating volume f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:58 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:58 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 1073741824 Apr 09 17:34:58 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:58 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 1073741824" returned: 0 in 0.544s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:58 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:34:58 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:59 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 0 in 0.490s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Attempting download of e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume f54756d5-760d-4db9-bbd8-6c42053bea3c. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8194a-1acd-4b7d-8c5b-721e85fa944e]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:59 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd Apr 09 17:34:59 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Flow 'volume_create_manager' (39dc66f2-59c9-48c0-b951-515f5f461111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1791b1-14a8-439a-9ad5-d2bd2a0f799b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1791b1-14a8-439a-9ad5-d2bd2a0f799b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405978410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3ed8d0-4774-4fa7-8307-12cbe68462f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438e225dd4184e6eaa763fe5af58af76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:00Z,use_quota=True,user_id='874b914b0d0b499c877cbdf1ab7fa220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c90bb-5259-4273-8d7f-7abb116c3140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c90bb-5259-4273-8d7f-7abb116c3140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d69e8c0-d8f7-4bb3-8fe5-fe3a2c4005f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d69e8c0-d8f7-4bb3-8fe5-fe3a2c4005f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3ed8d0-4774-4fa7-8307-12cbe68462f2', 'volume_name': 'volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5669bbf-b328-4d48-99b8-8c9a16e44229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5669bbf-b328-4d48-99b8-8c9a16e44229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95abd56-9236-4961-b78c-546990d152b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:34:59 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Volume 7c3ed8d0-4774-4fa7-8307-12cbe68462f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2', 'volume_size': 1} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405978410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3ed8d0-4774-4fa7-8307-12cbe68462f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438e225dd4184e6eaa763fe5af58af76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:00Z,use_quota=True,user_id='874b914b0d0b499c877cbdf1ab7fa220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Creating volume 7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:34:59 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:59 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 1073741824 Apr 09 17:34:59 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:34:59 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd" returned: 0 in 0.539s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:34:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:34:59 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd Apr 09 17:34:59 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:00 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd" returned: 1 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_yc5fauhd' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85c2dc-d617-49f0-8da6-f0412177bdd9]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:00 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 1073741824" returned: 0 in 0.616s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:00 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:35:00 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:00 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD Apr 09 17:35:00 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:00 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.592s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95abd56-9236-4961-b78c-546990d152b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e631bd7f-ba8a-4d1d-88ef-4e81192933d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:01 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Volume volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 (7c3ed8d0-4774-4fa7-8307-12cbe68462f2): created successfully Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e631bd7f-ba8a-4d1d-88ef-4e81192933d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Flow 'volume_create_manager' (39dc66f2-59c9-48c0-b951-515f5f461111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:01 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5608b706-62e4-4af9-a096-ad2d316e66fa tempest-VolumesActionsTest-2135536514 None] Created volume successfully. Apr 09 17:35:01 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD" returned: 0 in 0.832s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] e1c6f14c-6844-4aad-9551-57f242d39ddc was qcow2, converting to raw {{(pid=82701) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 17:35:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:01 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:01 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:02 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 0 in 1.100s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:02 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_1gdc4nw9devstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:35:02 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Converted 112.00 MB image at 101.58 MB/s Apr 09 17:35:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:02 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 1G Apr 09 17:35:02 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:02 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 1G" returned: 0 in 0.685s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[23260f76-bb3d-4127-bd8d-4d8c4482da5c]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:03 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:03 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Flow 'volume_create_manager' (b7a9b64e-8b31-47f9-b8ad-14b2d90518b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8593f31-3644-420c-8017-908a82682641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:03 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 0 in 0.602s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8593f31-3644-420c-8017-908a82682641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-200146670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2460e5-f006-4486-bdd9-8c5d31a6e05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a047e65f7094994b40586bbe1468f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:04Z,use_quota=True,user_id='19fe0ed5f21c45a88ab3c7b480efcdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add0f702-b490-4f6a-9d9c-0c64327d99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add0f702-b490-4f6a-9d9c-0c64327d99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c379678-40b7-4e14-b5e0-656b6e2911d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c379678-40b7-4e14-b5e0-656b6e2911d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2460e5-f006-4486-bdd9-8c5d31a6e05d', 'volume_name': 'volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be187d4-3de6-4065-be89-31b7fcf21b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be187d4-3de6-4065-be89-31b7fcf21b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158c33b3-cba4-48c9-b829-873dbc67b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:03 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Volume 3a2460e5-f006-4486-bdd9-8c5d31a6e05d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d', 'volume_size': 1} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-200146670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2460e5-f006-4486-bdd9-8c5d31a6e05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a047e65f7094994b40586bbe1468f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:04Z,use_quota=True,user_id='19fe0ed5f21c45a88ab3c7b480efcdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Creating volume 3a2460e5-f006-4486-bdd9-8c5d31a6e05d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:03 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:03 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d 1073741824 Apr 09 17:35:03 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:03 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:03 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:04 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d 1073741824" returned: 0 in 0.541s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:04 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 1 in 0.561s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Downloaded image e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume f54756d5-760d-4db9-bbd8-6c42053bea3c successfully. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc for user a69b478f75104a288aabcbb454578ecc is deleted. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Marking volume f54756d5-760d-4db9-bbd8-6c42053bea3c as bootable. {{(pid=82701) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 17:35:04 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d Apr 09 17:35:04 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Copying metadata from image e1c6f14c-6844-4aad-9551-57f242d39ddc to f54756d5-760d-4db9-bbd8-6c42053bea3c. {{(pid=82701) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Creating volume glance metadata for volume f54756d5-760d-4db9-bbd8-6c42053bea3c backed by image e1c6f14c-6844-4aad-9551-57f242d39ddc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82701) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f28dc64-1a89-4508-9f34-020c3e079467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54756d5-760d-4db9-bbd8-6c42053bea3c', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b32ddd1-3bca-46a2-8579-57ca2569da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Volume volume-f54756d5-760d-4db9-bbd8-6c42053bea3c (f54756d5-760d-4db9-bbd8-6c42053bea3c): created successfully Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b32ddd1-3bca-46a2-8579-57ca2569da4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Flow 'volume_create_manager' (655f1449-fcfe-41d8-b2dc-fba331e4557f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d252de64-a325-41f3-a683-0bed6b98bd11 tempest-VolumesExtendTest-485276454 None] Created volume successfully. Apr 09 17:35:04 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158c33b3-cba4-48c9-b829-873dbc67b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a2a76c-5ded-4e87-8953-9c1ff252e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Volume volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d (3a2460e5-f006-4486-bdd9-8c5d31a6e05d): created successfully Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a2a76c-5ded-4e87-8953-9c1ff252e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Flow 'volume_create_manager' (b7a9b64e-8b31-47f9-b8ad-14b2d90518b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-dd35ceb2-68b8-48ac-b4af-e920963f11fd tempest-VolumesServicesTestJSON-1238741675 None] Created volume successfully. Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bcc99f-0460-4521-aba1-a79bc2c1734b]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:05 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:05 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:05 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:05 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:05 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Acquiring lock "cinder-3a2460e5-f006-4486-bdd9-8c5d31a6e05d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Lock "cinder-3a2460e5-f006-4486-bdd9-8c5d31a6e05d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Acquiring lock "cinder-quobyte-3a2460e5-f006-4486-bdd9-8c5d31a6e05d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Lock "cinder-quobyte-3a2460e5-f006-4486-bdd9-8c5d31a6e05d" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf9769-ee22-4e8d-b328-68844e6e8db1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:05 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d Apr 09 17:35:05 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:06 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 1 in 0.557s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 2G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c 2G" returned: 0 in 0.051s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.149s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:06 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-87ff28c4-5e96-4c55-91e2-6f4e9be1b331 tempest-VolumesExtendTest-485276454 None] Extend volume completed successfully. Apr 09 17:35:06 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d" returned: 0 in 0.582s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:06 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d Apr 09 17:35:06 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:06 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3a2460e5-f006-4486-bdd9-8c5d31a6e05d" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Lock "cinder-quobyte-3a2460e5-f006-4486-bdd9-8c5d31a6e05d" released by "delete_volume" :: held 1.042s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Created reservations ['f3a90a05-8db2-46bd-a9ea-3baff0675e5d', '0db60a13-9ae8-4190-bdd5-a1a31ecd994b', '662d45f6-3f82-4218-8c41-2619bfb45030', '5af10c7e-f5ab-4ca9-935a-c8e9d7171b10'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:07 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:07 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-f54756d5-760d-4db9-bbd8-6c42053bea3c-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Lock "cinder-f54756d5-760d-4db9-bbd8-6c42053bea3c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-quobyte-f54756d5-760d-4db9-bbd8-6c42053bea3c" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-f54756d5-760d-4db9-bbd8-6c42053bea3c" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac70a11-c092-40cc-adb0-96a2f3a52e8c]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:07 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.599s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:07 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Deleted volume successfully. Apr 09 17:35:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-38324848-7b2d-4df0-89b9-e3a5c944900c tempest-VolumesServicesTestJSON-1238741675 None] Lock "cinder-3a2460e5-f006-4486-bdd9-8c5d31a6e05d-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:07 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:07 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:08 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 0 in 0.595s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:08 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:08 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:08 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:08 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:08 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.576s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:08 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 1 in 0.812s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:35:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:08 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c Apr 09 17:35:08 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:09 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f54756d5-760d-4db9-bbd8-6c42053bea3c" returned: 0 in 0.501s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-f54756d5-760d-4db9-bbd8-6c42053bea3c" released by "delete_volume" :: held 1.972s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Created reservations ['19f08751-8017-410b-b524-775ed13c1a69', '88909dbc-2783-4ecb-829c-1bf8f1f436b9', '07b80fb0-ba8a-401a-a820-63b783a53d83', '37e7e3f7-dafb-4d04-b26f-080e2c88f971'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:09 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:09 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Flow 'volume_create_manager' (477bdc61-7af0-4312-a867-1ddb056878cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe80348-0db8-4819-ba06-e4e0e60504e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe80348-0db8-4819-ba06-e4e0e60504e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1838528160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718c2896-4142-409f-b041-c227f44b0918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551acea6d45f4cb1aa1cc2bb36938ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:10Z,use_quota=True,user_id='a69b478f75104a288aabcbb454578ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7045bba0-4d5f-4cec-ae8e-8e680c0fc517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7045bba0-4d5f-4cec-ae8e-8e680c0fc517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6f0312-58e0-4a15-8933-cebfe52e1818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6f0312-58e0-4a15-8933-cebfe52e1818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718c2896-4142-409f-b041-c227f44b0918', 'volume_name': 'volume-718c2896-4142-409f-b041-c227f44b0918', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07adad7e-4b24-4d01-b66d-c9a5f80249e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07adad7e-4b24-4d01-b66d-c9a5f80249e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7b205b-4df5-4b9e-b3df-e1233010609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Volume 718c2896-4142-409f-b041-c227f44b0918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718c2896-4142-409f-b041-c227f44b0918', 'volume_size': 1} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1838528160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718c2896-4142-409f-b041-c227f44b0918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551acea6d45f4cb1aa1cc2bb36938ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:10Z,use_quota=True,user_id='a69b478f75104a288aabcbb454578ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Creating volume 718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:10 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:10 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 1073741824 Apr 09 17:35:10 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:10 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.625s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Deleted volume successfully. Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-23a9878e-7408-4868-9774-ec78c64f6d56 tempest-VolumesExtendTest-485276454 None] Lock "cinder-f54756d5-760d-4db9-bbd8-6c42053bea3c-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:10 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 1073741824" returned: 0 in 0.674s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:10 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 Apr 09 17:35:10 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:11 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918" returned: 0 in 0.821s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7b205b-4df5-4b9e-b3df-e1233010609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718c2896-4142-409f-b041-c227f44b0918', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3fcf80-3642-40ee-acde-abad2f0894c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:11 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Volume volume-718c2896-4142-409f-b041-c227f44b0918 (718c2896-4142-409f-b041-c227f44b0918): created successfully Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3fcf80-3642-40ee-acde-abad2f0894c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Flow 'volume_create_manager' (477bdc61-7af0-4312-a867-1ddb056878cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-74fbf78f-3712-4537-952a-359182da53b0 tempest-VolumesExtendTest-485276454 None] Created volume successfully. Apr 09 17:35:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Creating offline snapshot cf1f3940-7cc5-4249-b316-644cfa0361e6 of volume 718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:35:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4489191a-fcbb-4f62-bb61-47a88f087b5c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:12 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 Apr 09 17:35:12 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:13 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918" returned: 0 in 0.973s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:13 devstack sudo[86874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 1G Apr 09 17:35:13 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:14 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 1G" returned: 0 in 1.350s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718c2896-4142-409f-b041-c227f44b0918 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:14 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718c2896-4142-409f-b041-c227f44b0918 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 Apr 09 17:35:14 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Flow 'volume_create_manager' (f524e814-7c0e-47d2-a9e9-6f8c9dab096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe7564d-034a-48d5-83e0-fa082640bfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe7564d-034a-48d5-83e0-fa082640bfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-830973711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5575a427-b5e8-4ce6-9bd2-9451084f253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9b05b964914a758f7ba8f0972d8d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:15Z,use_quota=True,user_id='6be38592bad2423b888b3c67ab0418fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f07b609-da16-44c6-9cbf-6b5fc8c37905),volume_type_id=5f07b609-da16-44c6-9cbf-6b5fc8c37905)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015f2c6f-9306-470e-97bf-54227525c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015f2c6f-9306-470e-97bf-54227525c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5402aa0-b260-48f2-bad9-501eafd2e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5402aa0-b260-48f2-bad9-501eafd2e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5575a427-b5e8-4ce6-9bd2-9451084f253a', 'volume_name': 'volume-5575a427-b5e8-4ce6-9bd2-9451084f253a', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4369c231-6ad6-4b3b-aaab-2772404e41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4369c231-6ad6-4b3b-aaab-2772404e41d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61817dad-4306-4c39-a3e8-aafdb2f4f4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:15 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Volume 5575a427-b5e8-4ce6-9bd2-9451084f253a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5575a427-b5e8-4ce6-9bd2-9451084f253a', 'volume_size': 1} Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:15 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-718c2896-4142-409f-b041-c227f44b0918 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6" returned: 0 in 1.071s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:15 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 is being set with open permissions: ugo+rw Apr 09 17:35:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:15 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 Apr 09 17:35:15 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:16 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6" returned: 0 in 0.646s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:16 devstack sudo[86917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info Apr 09 17:35:16 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:17 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info" returned: 0 in 0.720s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:17 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info is being set with open permissions: ugo+rw Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:17 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info Apr 09 17:35:17 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b30662da-d868-4547-b101-05ce2ceb7833 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" by "attach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b30662da-d868-4547-b101-05ce2ceb7833 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" acquired by "attach_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b30662da-d868-4547-b101-05ce2ceb7833 tempest-VolumesActionsTest-2135536514 None] Attaching volume 7c3ed8d0-4774-4fa7-8307-12cbe68462f2 to instance 1a978ce4-624f-48a5-9988-bbcb4f4651a8 at mountpoint /dev/vdb on host None. Apr 09 17:35:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b30662da-d868-4547-b101-05ce2ceb7833 tempest-VolumesActionsTest-2135536514 None] Attach volume completed successfully. Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b30662da-d868-4547-b101-05ce2ceb7833 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" released by "attach_volume" :: held 0.114s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:17 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.info" returned: 0 in 0.651s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.497s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-830973711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5575a427-b5e8-4ce6-9bd2-9451084f253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9b05b964914a758f7ba8f0972d8d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:15Z,use_quota=True,user_id='6be38592bad2423b888b3c67ab0418fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f07b609-da16-44c6-9cbf-6b5fc8c37905),volume_type_id=5f07b609-da16-44c6-9cbf-6b5fc8c37905)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Creating volume 5575a427-b5e8-4ce6-9bd2-9451084f253a {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:17 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:17 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a 1073741824 Apr 09 17:35:17 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c410f0e9-66d5-4ef2-a09d-143c4d007f6f tempest-VolumesExtendTest-485276454 None] Create snapshot completed successfully Apr 09 17:35:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e4ec5147-4382-431c-9ea4-38dc9d3703d9 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-detach_volume" by "detach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e4ec5147-4382-431c-9ea4-38dc9d3703d9 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e4ec5147-4382-431c-9ea4-38dc9d3703d9 tempest-VolumesActionsTest-2135536514 None] Detaching volume 7c3ed8d0-4774-4fa7-8307-12cbe68462f2 from instance 1a978ce4-624f-48a5-9988-bbcb4f4651a8. Apr 09 17:35:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e4ec5147-4382-431c-9ea4-38dc9d3703d9 tempest-VolumesActionsTest-2135536514 None] Detach volume completed successfully. Apr 09 17:35:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e4ec5147-4382-431c-9ea4-38dc9d3703d9 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:18 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a 1073741824" returned: 0 in 0.643s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:18 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a Apr 09 17:35:18 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:19 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a" returned: 0 in 0.757s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.552s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61817dad-4306-4c39-a3e8-aafdb2f4f4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5575a427-b5e8-4ce6-9bd2-9451084f253a', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b119710e-f75a-4c9b-8e04-c4e294295d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[574890ab-d8f9-45dc-86ea-4465361bd2fe]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:19 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Volume volume-5575a427-b5e8-4ce6-9bd2-9451084f253a (5575a427-b5e8-4ce6-9bd2-9451084f253a): created successfully Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b119710e-f75a-4c9b-8e04-c4e294295d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Flow 'volume_create_manager' (f524e814-7c0e-47d2-a9e9-6f8c9dab096b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9b7efe70-3cc3-481f-87ea-4c2740a6f02e tempest-VolumeTypesAccessTest-1304263898 None] Created volume successfully. Apr 09 17:35:19 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 Apr 09 17:35:19 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Acquiring lock "cinder-5575a427-b5e8-4ce6-9bd2-9451084f253a-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Lock "cinder-5575a427-b5e8-4ce6-9bd2-9451084f253a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Acquiring lock "cinder-quobyte-5575a427-b5e8-4ce6-9bd2-9451084f253a" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Lock "cinder-quobyte-5575a427-b5e8-4ce6-9bd2-9451084f253a" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39a0cc-e8e9-45cb-aa88-93fb0a990518]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:19 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a Apr 09 17:35:19 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:19 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 2G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 2G" returned: 0 in 0.123s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.794s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:20 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f7e12d93-b80c-4962-a53b-959a22f7e809 tempest-VolumesExtendTest-485276454 None] Extend volume completed successfully. Apr 09 17:35:20 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a" returned: 0 in 0.804s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:20 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a Apr 09 17:35:20 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:21 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5575a427-b5e8-4ce6-9bd2-9451084f253a" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Lock "cinder-quobyte-5575a427-b5e8-4ce6-9bd2-9451084f253a" released by "delete_volume" :: held 1.392s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:21 devstack cinder-volume[82701]: WARNING cinder.quota [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1083027564 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1083027564, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:35:21 devstack cinder-volume[82701]: WARNING cinder.quota [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1083027564 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1083027564, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-cf1f3940-7cc5-4249-b316-644cfa0361e6-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Created reservations ['f0fc0714-8c74-4ad0-bc81-b1b9a383661d', 'dff74f20-f0b4-47d3-bf73-4eee1abbb9ff', '99fd5481-4b2c-4f5d-975a-11f7ab34441e', '0a98fc3f-eb12-4cdf-8750-ae0ec76c57a1'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Lock "cinder-cf1f3940-7cc5-4249-b316-644cfa0361e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-quobyte-718c2896-4142-409f-b041-c227f44b0918" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-718c2896-4142-409f-b041-c227f44b0918" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-quobyte-cf1f3940-7cc5-4249-b316-644cfa0361e6" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-cf1f3940-7cc5-4249-b316-644cfa0361e6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Deleting offline snapshot cf1f3940-7cc5-4249-b316-644cfa0361e6 of volume 718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] snapshot_file for this snap is: volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6072bea-3dca-411f-8a27-05c11cbd9fb1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:21 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:21 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:21 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 Apr 09 17:35:21 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:21 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6" returned: 0 in 0.687s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-718c2896-4142-409f-b041-c227f44b0918(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:35:22 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4a763c-9e1c-4b10-9d88-c6f3fd26a043]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:22 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.780s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:22 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:22 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Deleted volume successfully. Apr 09 17:35:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a63c0e12-6a8f-47d1-b3ef-bae314fc75e4 tempest-VolumeTypesAccessTest-1304263898 None] Lock "cinder-5575a427-b5e8-4ce6-9bd2-9451084f253a-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:22 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 Apr 09 17:35:22 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:23 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918" returned: 0 in 1.117s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:23 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 Apr 09 17:35:23 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Flow 'volume_create_manager' (27266adf-084e-440e-b405-f2748f9f8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6b585d-ce8a-41ef-b730-b117dc40f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6b585d-ce8a-41ef-b730-b117dc40f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1977642828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b01ad9-9091-4950-aa97-7e09886fbdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f706cc57f34dd6b7416a6d56822fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:24Z,use_quota=True,user_id='b29ddf04501c4619b643cd48a7d373f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660f7914-28f5-4fbe-b0ef-456d98394150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660f7914-28f5-4fbe-b0ef-456d98394150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59af3f3d-a2ad-452c-a81c-288a8a0503d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59af3f3d-a2ad-452c-a81c-288a8a0503d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b01ad9-9091-4950-aa97-7e09886fbdf6', 'volume_name': 'volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c264ffff-e821-4996-82a6-9e7eb35a3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c264ffff-e821-4996-82a6-9e7eb35a3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acd9528-dc29-4df8-8327-606724bc6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:24 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Volume b3b01ad9-9091-4950-aa97-7e09886fbdf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6', 'volume_size': 1} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1977642828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b01ad9-9091-4950-aa97-7e09886fbdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3f706cc57f34dd6b7416a6d56822fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:24Z,use_quota=True,user_id='b29ddf04501c4619b643cd48a7d373f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Creating volume b3b01ad9-9091-4950-aa97-7e09886fbdf6 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:24 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:24 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 1073741824 Apr 09 17:35:24 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:24 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6" returned: 0 in 1.154s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:24 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6 Apr 09 17:35:24 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:25 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918.cf1f3940-7cc5-4249-b316-644cfa0361e6" returned: 0 in 0.768s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:25 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 1073741824" returned: 0 in 0.875s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-cf1f3940-7cc5-4249-b316-644cfa0361e6" released by "_delete_snapshot" :: held 3.922s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-718c2896-4142-409f-b041-c227f44b0918" released by "delete_snapshot" :: held 3.944s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Created reservations ['8e930b3a-dd0f-4d90-8ae5-d13b88d394de', '40c7288a-5c9b-4192-a429-bef6f21076d2', '02bfe853-d3ae-49b8-b12e-e87debf3c69c', '1da3667c-9c0d-47d4-8777-5e22f555cec9'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:25 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 Apr 09 17:35:25 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Delete snapshot completed successfully. Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-efbfc957-c4e3-4177-8fb4-871d69b1f86b tempest-VolumesExtendTest-485276454 None] Lock "cinder-cf1f3940-7cc5-4249-b316-644cfa0361e6-delete_snapshot" released by "delete_snapshot" :: held 4.143s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-718c2896-4142-409f-b041-c227f44b0918-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Lock "cinder-718c2896-4142-409f-b041-c227f44b0918-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Acquiring lock "cinder-quobyte-718c2896-4142-409f-b041-c227f44b0918" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-718c2896-4142-409f-b041-c227f44b0918" acquired by "delete_volume" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d1565-24df-4944-be83-c76e05f3aa39]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:25 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 Apr 09 17:35:25 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:26 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6" returned: 0 in 1.217s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acd9528-dc29-4df8-8327-606724bc6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95fa2be-11e5-4eac-b4d0-f5331efcf7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Volume volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 (b3b01ad9-9091-4950-aa97-7e09886fbdf6): created successfully Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95fa2be-11e5-4eac-b4d0-f5331efcf7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Flow 'volume_create_manager' (27266adf-084e-440e-b405-f2748f9f8b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e4b6f403-fc74-48aa-aa5c-ebf83d682bb6 tempest-ServerRescueNegativeTestJSON-677279180 None] Created volume successfully. Apr 09 17:35:26 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918" returned: 0 in 1.231s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:27 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918 Apr 09 17:35:27 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:27 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-718c2896-4142-409f-b041-c227f44b0918" returned: 0 in 0.594s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Lock "cinder-quobyte-718c2896-4142-409f-b041-c227f44b0918" released by "delete_volume" :: held 1.919s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Created reservations ['5b635a91-abd7-48ec-bf02-22501b9698be', '3b99a1a8-1281-41f0-932a-95058518df69', '1abb63a5-3720-42a4-b935-26f1d57e4069', 'a4d7fc88-41f8-4174-bd52-c338b2a80c5f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:27 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:27 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:28 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 1.086s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:28 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:28 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Deleted volume successfully. Apr 09 17:35:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d5e04c2-fbbc-464a-8aec-6e6c10e1356f tempest-VolumesExtendTest-485276454 None] Lock "cinder-718c2896-4142-409f-b041-c227f44b0918-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Flow 'volume_create_manager' (2f6d78a8-b728-4e13-9038-9cf81bcb5d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c7fd61-77c2-433a-a7a6-314437c1d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c7fd61-77c2-433a-a7a6-314437c1d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-466200119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04c2a2fca3c746f2827f5783a0e4155f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:31Z,use_quota=True,user_id='79e8301f155a451b9c81a78904bf2aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d60a25-3942-491d-8251-0fe66d9b5512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d60a25-3942-491d-8251-0fe66d9b5512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4fc155-7bc0-4458-8e44-4acc8cf2a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4fc155-7bc0-4458-8e44-4acc8cf2a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d', 'volume_name': 'volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342ac768-b313-4995-bf3e-17fd031df58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342ac768-b313-4995-bf3e-17fd031df58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491444aa-eb73-472f-ad72-781e7ec1b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:30 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Volume fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d', 'volume_size': 1} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-466200119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04c2a2fca3c746f2827f5783a0e4155f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:31Z,use_quota=True,user_id='79e8301f155a451b9c81a78904bf2aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Creating volume fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:30 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:31 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d 1073741824 Apr 09 17:35:31 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:32 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d 1073741824" returned: 0 in 1.122s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:32 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d Apr 09 17:35:32 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Flow 'volume_create_manager' (3781bcde-2bbe-485b-8985-517e93086ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42575ab3-4a1c-4151-9a16-514eaa683c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42575ab3-4a1c-4151-9a16-514eaa683c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-599626497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c7ee77-93d6-499f-a361-2aaf5bb534a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b5e4bd0f7b4c6f8bbf83cdb1cea9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:33Z,use_quota=True,user_id='bf9d6172669b43a397ab234d836f5f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caca55e-296c-45fb-8f65-c78143b3f0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caca55e-296c-45fb-8f65-c78143b3f0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b4dcb8-01ad-487c-9520-98b31b02498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b4dcb8-01ad-487c-9520-98b31b02498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c7ee77-93d6-499f-a361-2aaf5bb534a4', 'volume_name': 'volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7744d195-e721-45c0-ab16-d95b49d88fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7744d195-e721-45c0-ab16-d95b49d88fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f6ec8e-9844-4088-bf10-814cabf1d657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:32 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Volume 61c7ee77-93d6-499f-a361-2aaf5bb534a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4', 'volume_size': 1} Apr 09 17:35:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:33 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d" returned: 0 in 0.924s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-599626497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c7ee77-93d6-499f-a361-2aaf5bb534a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b5e4bd0f7b4c6f8bbf83cdb1cea9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:33Z,use_quota=True,user_id='bf9d6172669b43a397ab234d836f5f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Creating volume 61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:33 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491444aa-eb73-472f-ad72-781e7ec1b603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a13c7e0-df2a-4734-a843-37c4bc2a8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:33 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 1073741824 Apr 09 17:35:33 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:33 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Volume volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d (fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d): created successfully Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a13c7e0-df2a-4734-a843-37c4bc2a8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Flow 'volume_create_manager' (2f6d78a8-b728-4e13-9038-9cf81bcb5d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-eed662c1-e98e-4cf3-91ed-0716589aaab6 tempest-VolumesListTestJSON-38979468 None] Created volume successfully. Apr 09 17:35:33 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 1073741824" returned: 0 in 0.801s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:33 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 Apr 09 17:35:33 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Flow 'volume_create_manager' (37af2c50-da25-45bd-b17a-7874292a6cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938892f0-1bb5-4334-8633-5de4043d01dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:34 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938892f0-1bb5-4334-8633-5de4043d01dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-216721670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4dd560-fd6c-451d-999d-6c2171d81b7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04c2a2fca3c746f2827f5783a0e4155f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:34Z,use_quota=True,user_id='79e8301f155a451b9c81a78904bf2aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d3a795-592f-4d15-bd01-72c6699d20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d3a795-592f-4d15-bd01-72c6699d20eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003d3d64-f8af-46b9-acdb-78584f1433f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003d3d64-f8af-46b9-acdb-78584f1433f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4dd560-fd6c-451d-999d-6c2171d81b7c', 'volume_name': 'volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fbff37-9d6c-41cf-b91e-4662c81b38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fbff37-9d6c-41cf-b91e-4662c81b38c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a493fc3-3fa7-4cbe-888a-8d8d223fa74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:34 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Volume bd4dd560-fd6c-451d-999d-6c2171d81b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c', 'volume_size': 1} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4" returned: 0 in 0.579s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-216721670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4dd560-fd6c-451d-999d-6c2171d81b7c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04c2a2fca3c746f2827f5783a0e4155f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:34Z,use_quota=True,user_id='79e8301f155a451b9c81a78904bf2aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Creating volume bd4dd560-fd6c-451d-999d-6c2171d81b7c {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:34 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f6ec8e-9844-4088-bf10-814cabf1d657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d9bf4a-3c1c-464d-93e1-3a74614bbea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:34 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c 1073741824 Apr 09 17:35:34 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:34 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Volume volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 (61c7ee77-93d6-499f-a361-2aaf5bb534a4): created successfully Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d9bf4a-3c1c-464d-93e1-3a74614bbea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Flow 'volume_create_manager' (3781bcde-2bbe-485b-8985-517e93086ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:34 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ae9e1c69-f3cc-4d06-8519-eeeafc44feef tempest-SnapshotMetadataTestJSON-164013913 None] Created volume successfully. Apr 09 17:35:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:35 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c 1073741824" returned: 0 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:35 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c Apr 09 17:35:35 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:35 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.639s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a493fc3-3fa7-4cbe-888a-8d8d223fa74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6023297-9f19-4fee-8e1f-53e0fdbcc43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Creating offline snapshot 443d6bf1-05ca-4408-8a6b-e0077c4b5990 of volume 61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:35:35 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Volume volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c (bd4dd560-fd6c-451d-999d-6c2171d81b7c): created successfully Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6023297-9f19-4fee-8e1f-53e0fdbcc43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Flow 'volume_create_manager' (37af2c50-da25-45bd-b17a-7874292a6cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0783e9a7-bf38-4bf3-891d-31e23cfcecca]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0ec67f68-615a-4ba8-bcd4-8f6bd04636e1 tempest-VolumesListTestJSON-38979468 None] Created volume successfully. Apr 09 17:35:35 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 Apr 09 17:35:35 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:36 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4" returned: 0 in 0.577s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:36 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 1G Apr 09 17:35:36 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Flow 'volume_create_manager' (de9e4443-a020-434e-8490-578ce7da594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653fbdec-a9f9-4360-ade8-6ed37c21a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653fbdec-a9f9-4360-ade8-6ed37c21a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1950189741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b39def5-9431-4685-86e1-7d308e092e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04c2a2fca3c746f2827f5783a0e4155f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:37Z,use_quota=True,user_id='79e8301f155a451b9c81a78904bf2aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b51d9b9-840e-4cc7-b3d1-f23c5c7a4d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b51d9b9-840e-4cc7-b3d1-f23c5c7a4d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:36 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9434a0a7-973d-4cad-be43-fc289a3ba896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9434a0a7-973d-4cad-be43-fc289a3ba896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b39def5-9431-4685-86e1-7d308e092e4f', 'volume_name': 'volume-0b39def5-9431-4685-86e1-7d308e092e4f', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94edfcd1-983d-450c-b5f3-a5462e1990d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94edfcd1-983d-450c-b5f3-a5462e1990d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f643804-a4ca-47a0-a347-7f247e7858cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:36 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Volume 0b39def5-9431-4685-86e1-7d308e092e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b39def5-9431-4685-86e1-7d308e092e4f', 'volume_size': 1} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 1G" returned: 0 in 0.595s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:36 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 Apr 09 17:35:36 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:37 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990" returned: 0 in 0.701s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:37 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 is being set with open permissions: ugo+rw Apr 09 17:35:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:37 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 Apr 09 17:35:37 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:38 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990" returned: 0 in 0.604s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:38 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info Apr 09 17:35:38 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:38 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info" returned: 0 in 0.599s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:38 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info is being set with open permissions: ugo+rw Apr 09 17:35:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:38 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info Apr 09 17:35:38 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:39 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.info" returned: 0 in 0.660s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.891s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.641s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1950189741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b39def5-9431-4685-86e1-7d308e092e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04c2a2fca3c746f2827f5783a0e4155f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:37Z,use_quota=True,user_id='79e8301f155a451b9c81a78904bf2aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Creating volume 0b39def5-9431-4685-86e1-7d308e092e4f {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:39 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:39 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f 1073741824 Apr 09 17:35:39 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-51681136-3897-4349-a99f-b88434895bfb tempest-SnapshotMetadataTestJSON-164013913 None] Create snapshot completed successfully Apr 09 17:35:40 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f 1073741824" returned: 0 in 0.869s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:40 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=97,cinder:UPDATE=121,cinder:DELETE=13,cinder:INSERT=41 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:35:40 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=112,cinder:INSERT=31,cinder:UPDATE=134,cinder:DELETE=9 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:35:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:40 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f Apr 09 17:35:40 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "cinder-443d6bf1-05ca-4408-8a6b-e0077c4b5990-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-443d6bf1-05ca-4408-8a6b-e0077c4b5990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "cinder-quobyte-61c7ee77-93d6-499f-a361-2aaf5bb534a4" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-quobyte-61c7ee77-93d6-499f-a361-2aaf5bb534a4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "cinder-quobyte-443d6bf1-05ca-4408-8a6b-e0077c4b5990" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-quobyte-443d6bf1-05ca-4408-8a6b-e0077c4b5990" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Deleting offline snapshot 443d6bf1-05ca-4408-8a6b-e0077c4b5990 of volume 61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] snapshot_file for this snap is: volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f63be0-007f-468f-9813-5627212711f5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:41 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f" returned: 0 in 1.160s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f643804-a4ca-47a0-a347-7f247e7858cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b39def5-9431-4685-86e1-7d308e092e4f', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed1c816-33c1-43d9-9f64-b07473c83dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:41 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Volume volume-0b39def5-9431-4685-86e1-7d308e092e4f (0b39def5-9431-4685-86e1-7d308e092e4f): created successfully Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed1c816-33c1-43d9-9f64-b07473c83dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Flow 'volume_create_manager' (de9e4443-a020-434e-8490-578ce7da594d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-859e1928-d4a8-427e-b7c2-69375ec090e6 tempest-VolumesListTestJSON-38979468 None] Created volume successfully. Apr 09 17:35:41 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 Apr 09 17:35:41 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:42 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990" returned: 0 in 0.633s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:35:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9cd1a-5095-45a1-857e-4e45d40854ea]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:42 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 Apr 09 17:35:42 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-58254170-b773-486b-a4dd-d03642695966 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" by "attach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-58254170-b773-486b-a4dd-d03642695966 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" acquired by "attach_volume" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-58254170-b773-486b-a4dd-d03642695966 tempest-VolumesActionsTest-2135536514 None] Attaching volume 7c3ed8d0-4774-4fa7-8307-12cbe68462f2 to instance 671d5884-2e89-4b69-9c3a-d0541a141043 at mountpoint /dev/vdb on host None. Apr 09 17:35:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-58254170-b773-486b-a4dd-d03642695966 tempest-VolumesActionsTest-2135536514 None] Attach volume completed successfully. Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-58254170-b773-486b-a4dd-d03642695966 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" released by "attach_volume" :: held 0.175s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:43 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4" returned: 0 in 1.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:43 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 Apr 09 17:35:43 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-93be873d-16c2-4716-a7d3-f9dd4f026901 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-detach_volume" by "detach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-93be873d-16c2-4716-a7d3-f9dd4f026901 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-93be873d-16c2-4716-a7d3-f9dd4f026901 tempest-VolumesActionsTest-2135536514 None] Detaching volume 7c3ed8d0-4774-4fa7-8307-12cbe68462f2 from instance 671d5884-2e89-4b69-9c3a-d0541a141043. Apr 09 17:35:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-93be873d-16c2-4716-a7d3-f9dd4f026901 tempest-VolumesActionsTest-2135536514 None] Detach volume completed successfully. Apr 09 17:35:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-93be873d-16c2-4716-a7d3-f9dd4f026901 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:45 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990" returned: 0 in 1.642s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:45 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990 Apr 09 17:35:45 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "cinder-0b39def5-9431-4685-86e1-7d308e092e4f-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-0b39def5-9431-4685-86e1-7d308e092e4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "cinder-quobyte-0b39def5-9431-4685-86e1-7d308e092e4f" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-quobyte-0b39def5-9431-4685-86e1-7d308e092e4f" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e338061-afc8-4d1f-80b3-8a24a85c0e4a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:45 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f Apr 09 17:35:45 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Acquiring lock "cinder-b3b01ad9-9091-4950-aa97-7e09886fbdf6-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "cinder-b3b01ad9-9091-4950-aa97-7e09886fbdf6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Acquiring lock "cinder-quobyte-b3b01ad9-9091-4950-aa97-7e09886fbdf6" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "cinder-quobyte-b3b01ad9-9091-4950-aa97-7e09886fbdf6" acquired by "delete_volume" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:46 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df09a2b-8365-4de3-a533-e394d93174d1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4.443d6bf1-05ca-4408-8a6b-e0077c4b5990" returned: 0 in 0.871s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-quobyte-443d6bf1-05ca-4408-8a6b-e0077c4b5990" released by "_delete_snapshot" :: held 4.906s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-quobyte-61c7ee77-93d6-499f-a361-2aaf5bb534a4" released by "delete_snapshot" :: held 4.934s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:46 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 Apr 09 17:35:46 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Created reservations ['0b5af862-b5fb-45cb-a69f-ba8c5c0be54d', 'b1839685-78c2-4eb4-9f9d-9a75279c6ba5', '508b6be4-71c4-477e-b8c5-9be1487ff001', '0d731b73-65f2-454b-b5b0-e1957c7fea11'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Delete snapshot completed successfully. Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-496c6704-1aa7-4d3a-aaea-16f6e9d4b4f0 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-443d6bf1-05ca-4408-8a6b-e0077c4b5990-delete_snapshot" released by "delete_snapshot" :: held 5.153s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:46 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f" returned: 0 in 1.053s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:46 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f Apr 09 17:35:46 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "cinder-61c7ee77-93d6-499f-a361-2aaf5bb534a4-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-61c7ee77-93d6-499f-a361-2aaf5bb534a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "cinder-quobyte-61c7ee77-93d6-499f-a361-2aaf5bb534a4" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-quobyte-61c7ee77-93d6-499f-a361-2aaf5bb534a4" acquired by "delete_volume" :: waited 0.025s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:46 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11aba3c-c4ac-4ad2-b661-e8fb2b9a90e9]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:47 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6" returned: 0 in 1.041s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:47 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 Apr 09 17:35:47 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:47 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6 Apr 09 17:35:47 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:47 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0b39def5-9431-4685-86e1-7d308e092e4f" returned: 0 in 0.892s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-quobyte-0b39def5-9431-4685-86e1-7d308e092e4f" released by "delete_volume" :: held 2.028s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Created reservations ['53114c9a-55f0-4c2a-8b35-537c48387308', 'ee62043a-a44f-4ea9-9e13-43207e232463', '93fc52d4-3bd3-4556-a377-3243046d00a0', 'e2563c3a-5cf6-4c6d-b08b-d6240c40a157'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:47 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b3b01ad9-9091-4950-aa97-7e09886fbdf6" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "cinder-quobyte-b3b01ad9-9091-4950-aa97-7e09886fbdf6" released by "delete_volume" :: held 1.642s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:47 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:47 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Created reservations ['ad172824-3805-4f22-9058-89e7a2143226', '32bca479-ff36-410e-91bb-e0b193e09bfc', '1483a27a-97d3-4629-9a72-e2a3650b6cff', '50d2b559-ee6f-45e0-8fa2-c86b693ce712'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "cinder-bd4dd560-fd6c-451d-999d-6c2171d81b7c-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-bd4dd560-fd6c-451d-999d-6c2171d81b7c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "cinder-quobyte-bd4dd560-fd6c-451d-999d-6c2171d81b7c" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:48 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-quobyte-bd4dd560-fd6c-451d-999d-6c2171d81b7c" acquired by "delete_volume" :: waited 0.073s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4" returned: 0 in 1.179s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:48 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:48 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dac97f-e10c-4d38-bf7a-52cbe51a1c56]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:48 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4 Apr 09 17:35:48 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:48 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c Apr 09 17:35:48 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:48 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.773s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Deleted volume successfully. Apr 09 17:35:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bfd9f948-344c-480a-8d99-ef6f50078e59 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-0b39def5-9431-4685-86e1-7d308e092e4f-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:49 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c" returned: 0 in 0.833s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:49 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c Apr 09 17:35:49 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:49 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-61c7ee77-93d6-499f-a361-2aaf5bb534a4" returned: 0 in 0.953s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-quobyte-61c7ee77-93d6-499f-a361-2aaf5bb534a4" released by "delete_volume" :: held 2.230s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:49 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 1.124s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Deleted volume successfully. Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Created reservations ['ced1d255-8cc5-433f-a5f1-e0fd6a995dc5', '5d260490-e5d1-4e77-81df-7645106f212c', 'f81fbdca-ad0b-458f-bfa3-16cea4695275', '724c28bb-3695-4682-933b-36bcd6e46739'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-10b736b8-12f0-4c54-823a-c28c88806311 tempest-ServerRescueNegativeTestJSON-677279180 None] Lock "cinder-b3b01ad9-9091-4950-aa97-7e09886fbdf6-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:49 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:49 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:49 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd4dd560-fd6c-451d-999d-6c2171d81b7c" returned: 0 in 0.649s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-quobyte-bd4dd560-fd6c-451d-999d-6c2171d81b7c" released by "delete_volume" :: held 1.668s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Created reservations ['b228dae3-f071-466d-896a-b1645fa5370d', 'db89608e-eef2-418b-8512-b442013ee8e3', '15043f11-1cf0-4828-a6e0-4070433672e2', '09a60c41-5d73-43ea-a7e3-48b9bf7b0034'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:49 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.662s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Deleted volume successfully. Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9d0fb90f-8942-468a-a204-cab6d782c0e5 tempest-SnapshotMetadataTestJSON-164013913 None] Lock "cinder-61c7ee77-93d6-499f-a361-2aaf5bb534a4-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:50 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:50 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "cinder-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "cinder-quobyte-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-quobyte-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d" acquired by "delete_volume" :: waited 0.034s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f37ee47-2cde-449d-886f-b8507cb7610b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:50 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d Apr 09 17:35:50 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:50 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 1.012s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:50 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Deleted volume successfully. Apr 09 17:35:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb7d4b1e-45b8-4da6-baff-a38613bc4219 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-bd4dd560-fd6c-451d-999d-6c2171d81b7c-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:51 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d" returned: 0 in 1.090s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:51 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d Apr 09 17:35:51 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:52 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d" returned: 0 in 0.612s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-quobyte-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d" released by "delete_volume" :: held 1.740s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Created reservations ['50748a4c-bac0-44e0-94be-67c5d7604737', '8120538d-031d-4a10-8594-c98e55eba08b', '911d472b-4e5f-4167-a740-1e5c30574932', '9a0f88aa-bd08-42c3-ba69-da507763de0c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:52 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:35:52 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:52 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (acb63bff-d9d5-4083-9cac-92fabd14ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f510190e-9847-4b53-a5d7-ffa2810709f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f510190e-9847-4b53-a5d7-ffa2810709f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-531880810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f131cb24-191b-4d73-8282-65095b9af01d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:53Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:53 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8990760f-b9aa-4803-a6b1-94fcfd1c734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8990760f-b9aa-4803-a6b1-94fcfd1c734e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c34243-4963-467e-8c3c-34796692b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c34243-4963-467e-8c3c-34796692b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f131cb24-191b-4d73-8282-65095b9af01d', 'volume_name': 'volume-f131cb24-191b-4d73-8282-65095b9af01d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5300f6b7-122d-488d-a342-a7cc38aa36b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5300f6b7-122d-488d-a342-a7cc38aa36b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb97e0a-7b34-4327-9e89-413c14a754a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:53 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Volume f131cb24-191b-4d73-8282-65095b9af01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f131cb24-191b-4d73-8282-65095b9af01d', 'volume_size': 1} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-531880810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f131cb24-191b-4d73-8282-65095b9af01d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:53Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Creating volume f131cb24-191b-4d73-8282-65095b9af01d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:35:53 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.706s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:35:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Deleted volume successfully. Apr 09 17:35:53 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d 1073741824 Apr 09 17:35:53 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-52b3f813-8354-4fbf-a013-8945ffc93d44 tempest-VolumesListTestJSON-38979468 None] Lock "cinder-fab2ddc7-7b3f-4e95-ac4f-ebcfb7a0c15d-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:35:53 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d 1073741824" returned: 0 in 0.714s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:53 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d Apr 09 17:35:53 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:54 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d" returned: 0 in 0.560s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb97e0a-7b34-4327-9e89-413c14a754a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f131cb24-191b-4d73-8282-65095b9af01d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed000b0-2178-47eb-a096-310fa2432765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Volume volume-f131cb24-191b-4d73-8282-65095b9af01d (f131cb24-191b-4d73-8282-65095b9af01d): created successfully Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed000b0-2178-47eb-a096-310fa2432765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (acb63bff-d9d5-4083-9cac-92fabd14ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-319f18ed-0d92-486c-bb68-5cbd795c9a03 tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195a174-aef5-4173-b190-99fb6cdfd91a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:54 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:35:54 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:55 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede35fad-6325-4b63-a7ad-5de36978f74a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:55 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:35:55 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (44551ad5-fc15-4d4a-8680-970b4c45cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56477545-0217-4ef2-a81d-3a4f97b60aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56477545-0217-4ef2-a81d-3a4f97b60aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1890668888',display_name='tempest-VolumesGetTest-Volume-1903190827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4be2eda-119c-429b-bc4c-9757df9e1713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:56Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb72132-901a-4700-908b-aedf9e69280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb72132-901a-4700-908b-aedf9e69280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed90d24-6335-415b-9ce8-ba60455b79f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed90d24-6335-415b-9ce8-ba60455b79f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4be2eda-119c-429b-bc4c-9757df9e1713', 'volume_name': 'volume-c4be2eda-119c-429b-bc4c-9757df9e1713', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7818b9d4-70ed-48ac-9a21-bb5fe9d8d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7818b9d4-70ed-48ac-9a21-bb5fe9d8d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ea3625-618a-4ab3-ba13-aa6bfb620aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:35:55 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Volume c4be2eda-119c-429b-bc4c-9757df9e1713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4be2eda-119c-429b-bc4c-9757df9e1713', 'volume_size': 1} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:35:55 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.790s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.2f85569b-e229-499f-93f5-f3171347f8d7_2jcfifh.img {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:55 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.2f85569b-e229-499f-93f5-f3171347f8d7_2jcfifh.img Apr 09 17:35:55 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:58 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.2f85569b-e229-499f-93f5-f3171347f8d7_2jcfifh.img" returned: 0 in 2.763s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb0a310-7ffe-4968-bd70-6fc3aaa7ea0f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:35:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:35:58 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:35:58 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:35:59 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 09 17:35:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.700s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:35:59 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.2f85569b-e229-499f-93f5-f3171347f8d7_2jcfifh.img {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:35:59 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Converted 1024.00 MB image at 370.40 MB/s Apr 09 17:35:59 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] 2f85569b-e229-499f-93f5-f3171347f8d7 was raw, no need to convert to raw {{(pid=82701) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 09 17:36:05 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=43,cinder:INSERT=13,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (11c16667-a0c3-48e0-be25-1b13e43be6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355f918-436f-4080-81ee-4f922fa0f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e355f918-436f-4080-81ee-4f922fa0f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2004366563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef44c9e-d114-4c38-a10f-e4e15dfcebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:06Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0587c98a-789c-496f-957e-f697522e9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0587c98a-789c-496f-957e-f697522e9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7d2f4c-feaa-4d7a-99f8-a221c8acd6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7d2f4c-feaa-4d7a-99f8-a221c8acd6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef44c9e-d114-4c38-a10f-e4e15dfcebfb', 'volume_name': 'volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428b171a-80b5-46d5-aed3-0bb45efe653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428b171a-80b5-46d5-aed3-0bb45efe653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf76651-ce01-40f6-bdb9-27ef6b617303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:06 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Volume 8ef44c9e-d114-4c38-a10f-e4e15dfcebfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb', 'volume_size': 1} Apr 09 17:36:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:08 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:08 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:08 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.560s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.162s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Uploaded volume to glance image-id: 2f85569b-e229-499f-93f5-f3171347f8d7. {{(pid=82701) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.015s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:35:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1890668888',display_name='tempest-VolumesGetTest-Volume-1903190827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4be2eda-119c-429b-bc4c-9757df9e1713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:35:56Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Creating volume c4be2eda-119c-429b-bc4c-9757df9e1713 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:10 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:10 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 1073741824 Apr 09 17:36:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3b33f421-fd9c-44d7-ba4f-3bee19ef335a tempest-VolumesActionsTest-2135536514 None] Copy volume to image completed successfully. Apr 09 17:36:10 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:11 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 1073741824" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:11 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 Apr 09 17:36:11 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:11 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713" returned: 0 in 0.513s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.542s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2004366563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef44c9e-d114-4c38-a10f-e4e15dfcebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:06Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Creating volume 8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:11 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:11 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb 1073741824 Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ea3625-618a-4ab3-ba13-aa6bfb620aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4be2eda-119c-429b-bc4c-9757df9e1713', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:11 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3432ac72-0d87-4af6-a39a-a5aba5bfa77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:11 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Volume volume-c4be2eda-119c-429b-bc4c-9757df9e1713 (c4be2eda-119c-429b-bc4c-9757df9e1713): created successfully Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3432ac72-0d87-4af6-a39a-a5aba5bfa77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (44551ad5-fc15-4d4a-8680-970b4c45cf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ee56b46b-7473-48eb-9543-7d28c1b4a2ef tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:36:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-c4be2eda-119c-429b-bc4c-9757df9e1713-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Lock "cinder-c4be2eda-119c-429b-bc4c-9757df9e1713-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-c4be2eda-119c-429b-bc4c-9757df9e1713" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-c4be2eda-119c-429b-bc4c-9757df9e1713" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af7323-9045-477f-b08d-c80eb2bbafe5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:12 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 Apr 09 17:36:12 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:12 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb 1073741824" returned: 0 in 0.577s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:12 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb Apr 09 17:36:12 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:12 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713" returned: 0 in 0.587s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:12 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713 Apr 09 17:36:12 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:12 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" returned: 0 in 0.478s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.998s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf76651-ce01-40f6-bdb9-27ef6b617303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51eb106-bec4-4ae9-a434-633fbdc99357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e843ddc4-aedc-463c-b397-88cb87981c09]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:12 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Volume volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb (8ef44c9e-d114-4c38-a10f-e4e15dfcebfb): created successfully Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51eb106-bec4-4ae9-a434-633fbdc99357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:12 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (11c16667-a0c3-48e0-be25-1b13e43be6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:12 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-09789b41-1139-4ce8-aba2-59c596f71586 tempest-VolumesSnapshotTestJSON-258885215 None] Created volume successfully. Apr 09 17:36:12 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:36:12 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:13 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c4be2eda-119c-429b-bc4c-9757df9e1713" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-c4be2eda-119c-429b-bc4c-9757df9e1713" released by "delete_volume" :: held 1.120s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Created reservations ['48b5a94f-086f-4914-81e6-3480ef949459', '38368138-0795-4b85-a568-f8bc36b6afcf', '05b812e1-cf40-4e9f-b50d-2bf0498d3fa5', '2d0ff9de-93d2-495e-a90c-144762d635b1'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:13 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.497s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7728f5-ccfb-4a63-b6eb-8d64410432ca]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:13 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:13 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-97aaeb47-0c8b-4012-a0e5-fcd0dd2d7236 tempest-GroupSnapshotsV319Test-308651635 None] Group tempest-GroupSnapshotsV319Test-Group-7220347: creating Apr 09 17:36:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-97aaeb47-0c8b-4012-a0e5-fcd0dd2d7236 tempest-GroupSnapshotsV319Test-308651635 None] Group tempest-GroupSnapshotsV319Test-Group-7220347: created successfully Apr 09 17:36:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-97aaeb47-0c8b-4012-a0e5-fcd0dd2d7236 tempest-GroupSnapshotsV319Test-308651635 None] Create group completed successfully. Apr 09 17:36:13 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:36:13 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:13 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-92bdab90-95d6-473d-9cc6-0ea0e1fb5d06 tempest-VolumesGetTest-1239197335 None] Lock "cinder-c4be2eda-119c-429b-bc4c-9757df9e1713-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:13 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.537s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:13 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img Apr 09 17:36:13 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-f131cb24-191b-4d73-8282-65095b9af01d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Lock "cinder-f131cb24-191b-4d73-8282-65095b9af01d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-f131cb24-191b-4d73-8282-65095b9af01d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-f131cb24-191b-4d73-8282-65095b9af01d" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:14 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f2d08-5b43-48e7-b97d-94a14ca17f24]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:14 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d Apr 09 17:36:14 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Flow 'volume_create_manager' (68b014d5-99df-402c-bd13-e09dfd88d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45aa6cf-de1a-418b-bab5-a81c72e83dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45aa6cf-de1a-418b-bab5-a81c72e83dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53701516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbe7db67-26c6-4c2f-b230-93335e4e763c,host='devstack@QuobyteHD#QuobyteHD',id=b5808105-2eff-4033-a8de-01fc683e35bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f05d66a69a42d0aa3b466f84744c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:15Z,use_quota=True,user_id='38e38bb124714b1180548c52950fb3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1219ca-f74a-49e4-867c-c5dbc86a3c20),volume_type_id=ee1219ca-f74a-49e4-867c-c5dbc86a3c20)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19c3b40-8bbe-41aa-bf2a-933797e03206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19c3b40-8bbe-41aa-bf2a-933797e03206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1078b5b4-6af7-42bb-93be-10fc7f4e6a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:15 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1078b5b4-6af7-42bb-93be-10fc7f4e6a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5808105-2eff-4033-a8de-01fc683e35bf', 'volume_name': 'volume-b5808105-2eff-4033-a8de-01fc683e35bf', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cb3152-f44b-46bd-9c3f-382e22f4d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11cb3152-f44b-46bd-9c3f-382e22f4d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd811b55-7abf-4d90-af47-f203d77234eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:15 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Volume b5808105-2eff-4033-a8de-01fc683e35bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5808105-2eff-4033-a8de-01fc683e35bf', 'volume_size': 1} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d" returned: 0 in 1.280s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:15 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d Apr 09 17:36:15 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:16 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img" returned: 0 in 2.221s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ca398-30f5-47b8-9124-e4110f9075c3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:16 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:36:16 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:16 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f131cb24-191b-4d73-8282-65095b9af01d" returned: 0 in 0.630s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-f131cb24-191b-4d73-8282-65095b9af01d" released by "delete_volume" :: held 1.943s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Created reservations ['b0a9f733-b24b-41bc-bd65-9f52978d71c6', '92b7c983-3bd0-49e0-b339-6af78e2a9f95', '5b776348-56a9-4a14-a2ca-7d193d49a17f', '052ab418-7351-491b-906a-3c70e0bd3885'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:16 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:16 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:16 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.608s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:36:16 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Converted 1024.00 MB image at 460.73 MB/s Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] 8c89361c-a8de-4933-b777-d21fb84519eb was raw, converting to qcow2 {{(pid=82701) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a56d15c-1472-4f98-91ff-0c70778e8430]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (1aff2b52-a5ad-4c72-ab24-ac22d8c6fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abff2cf8-ab64-45c9-be7b-6929b74bbbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:16 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img Apr 09 17:36:16 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abff2cf8-ab64-45c9-be7b-6929b74bbbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2002239255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d518e81-2774-49cf-b219-e669e26772dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:17Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17703c3f-208a-4132-b858-708b071863d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:16 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17703c3f-208a-4132-b858-708b071863d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a227b7d-6c95-40af-b8d1-b27b5b23e2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a227b7d-6c95-40af-b8d1-b27b5b23e2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d518e81-2774-49cf-b219-e669e26772dd', 'volume_name': 'volume-1d518e81-2774-49cf-b219-e669e26772dd', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f78c46-0615-4e2c-9d89-35454071026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f78c46-0615-4e2c-9d89-35454071026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9eca5-6802-4ed7-a5d8-d3051d11b2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:16 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Volume 1d518e81-2774-49cf-b219-e669e26772dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d518e81-2774-49cf-b219-e669e26772dd', 'volume_size': 1} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.502s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:16 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:36:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0bbcb2f3-df24-4ffb-8564-4385937f7ebe tempest-VolumesGetTest-1239197335 None] Lock "cinder-f131cb24-191b-4d73-8282-65095b9af01d-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:17 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:17 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img Apr 09 17:36:17 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:17 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img" returned: 1 in 0.450s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:36:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img /opt/stack/data/cinder/conversion/vol_upload_elolxahx {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:17 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img /opt/stack/data/cinder/conversion/vol_upload_elolxahx Apr 09 17:36:17 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:18 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img /opt/stack/data/cinder/conversion/vol_upload_elolxahx" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:18 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Image conversion details: src /opt/stack/data/cinder/conversion/7c3ed8d0-4774-4fa7-8307-12cbe68462f2.temp_image.8c89361c-a8de-4933-b777-d21fb84519ebb042xrfv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_elolxahx {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:36:18 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 09 17:36:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d295964-262f-42fa-8b7e-ea995b0acc7d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_elolxahx {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:18 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_elolxahx Apr 09 17:36:18 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:18 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_elolxahx" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.516s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Uploaded volume to glance image-id: 8c89361c-a8de-4933-b777-d21fb84519eb. {{(pid=82701) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.661s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Creating offline snapshot 6e51b000-f64d-4b4e-9313-ec0f1357e67b of volume 8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5dcda8-2b44-4a22-8f3a-2ff984d8ed4b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-481e495f-ab6a-4a2f-9b17-fb9035dab9b4 tempest-VolumesActionsTest-2135536514 None] Copy volume to image completed successfully. Apr 09 17:36:19 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb Apr 09 17:36:19 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:19 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" returned: 0 in 0.452s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:19 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b 1G Apr 09 17:36:19 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:20 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b 1G" returned: 0 in 0.484s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:20 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b Apr 09 17:36:20 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "cinder-quobyte-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-quobyte-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdbf80f-9a03-434f-a94c-63d0519a8a37]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:20 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:36:20 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:20 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:20 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b is being set with open permissions: ugo+rw Apr 09 17:36:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:20 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b Apr 09 17:36:20 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:21 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.506s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:21 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2 Apr 09 17:36:21 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:21 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b" returned: 0 in 0.397s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:21 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info Apr 09 17:36:21 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:21 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" returned: 0 in 0.427s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-quobyte-7c3ed8d0-4774-4fa7-8307-12cbe68462f2" released by "delete_volume" :: held 0.954s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Created reservations ['da542238-a59b-489d-870e-a62869c3ae1f', 'f7a99e8a-6007-4319-bbf6-3a73b392bd7c', 'bb398e93-b5df-4230-8a47-8ca560f43c5b', 'c60eb98e-9222-474c-acb5-101aa0b35347'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:21 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:21 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:21 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info" returned: 0 in 0.415s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:21 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info is being set with open permissions: ugo+rw Apr 09 17:36:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:21 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info Apr 09 17:36:21 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:22 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.info" returned: 0 in 0.390s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.356s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbe7db67-26c6-4c2f-b230-93335e4e763c,created_at=2026-04-09T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53701516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbe7db67-26c6-4c2f-b230-93335e4e763c,host='devstack@QuobyteHD#QuobyteHD',id=b5808105-2eff-4033-a8de-01fc683e35bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f05d66a69a42d0aa3b466f84744c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:15Z,use_quota=True,user_id='38e38bb124714b1180548c52950fb3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1219ca-f74a-49e4-867c-c5dbc86a3c20),volume_type_id=ee1219ca-f74a-49e4-867c-c5dbc86a3c20)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Creating volume b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:22 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:22 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.460s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:22 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf 1073741824 Apr 09 17:36:22 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:22 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Deleted volume successfully. Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a816c78e-eef4-4c6e-aa12-67b249b64543 tempest-VolumesActionsTest-2135536514 None] Lock "cinder-7c3ed8d0-4774-4fa7-8307-12cbe68462f2-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:22 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-91552668-38b6-47ff-b334-c14548fffd30 tempest-VolumesSnapshotTestJSON-258885215 None] Create snapshot completed successfully Apr 09 17:36:22 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf 1073741824" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:22 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf Apr 09 17:36:22 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:22 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.103s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2002239255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d518e81-2774-49cf-b219-e669e26772dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:17Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Creating volume 1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:22 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd811b55-7abf-4d90-af47-f203d77234eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5808105-2eff-4033-a8de-01fc683e35bf', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2184186-c3ea-4640-b2ee-d3c494135d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:23 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd 1073741824 Apr 09 17:36:23 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Volume volume-b5808105-2eff-4033-a8de-01fc683e35bf (b5808105-2eff-4033-a8de-01fc683e35bf): created successfully Apr 09 17:36:23 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2184186-c3ea-4640-b2ee-d3c494135d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Flow 'volume_create_manager' (68b014d5-99df-402c-bd13-e09dfd88d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b6ae54ee-e48a-4fe6-9e49-b117c66a36e3 tempest-GroupSnapshotsV319Test-308651635 None] Created volume successfully. Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-6e51b000-f64d-4b4e-9313-ec0f1357e67b-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-6e51b000-f64d-4b4e-9313-ec0f1357e67b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-6e51b000-f64d-4b4e-9313-ec0f1357e67b" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-6e51b000-f64d-4b4e-9313-ec0f1357e67b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Deleting offline snapshot 6e51b000-f64d-4b4e-9313-ec0f1357e67b of volume 8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] snapshot_file for this snap is: volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d81f5c6-a110-40bf-9a2b-bb59af147e7d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:23 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b Apr 09 17:36:23 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:23 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd 1073741824" returned: 0 in 0.569s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:23 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:23 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:23 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b" returned: 0 in 0.568s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb4d4c-9ded-405b-acc3-7568e5722c7c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:23 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb Apr 09 17:36:23 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:24 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] GroupSnapshot 208c1e17-bc97-44d4-88ae-9821493c79bc: creating. Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Group snapshot 208c1e17-bc97-44d4-88ae-9821493c79bc: creating. {{(pid=82701) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:24 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.063s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9eca5-6802-4ed7-a5d8-d3051d11b2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d518e81-2774-49cf-b219-e669e26772dd', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962003c0-87fb-49b4-9085-8ac96a74f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Creating offline snapshot a1169a4e-bd60-4976-acd7-5c83877231a3 of volume b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:36:24 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Volume volume-1d518e81-2774-49cf-b219-e669e26772dd (1d518e81-2774-49cf-b219-e669e26772dd): created successfully Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962003c0-87fb-49b4-9085-8ac96a74f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (1aff2b52-a5ad-4c72-ab24-ac22d8c6fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9709ee56-babd-4674-bdc0-216017f9dc6d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:24 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-08c7b062-b730-4756-b8d6-54a5dcf8d758 tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:36:24 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf Apr 09 17:36:24 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:24 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" returned: 0 in 0.609s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:24 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b Apr 09 17:36:24 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:24 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf" returned: 0 in 0.525s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:24 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 1G Apr 09 17:36:24 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:24 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b" returned: 0 in 0.537s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:25 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b Apr 09 17:36:25 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:25 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 1G" returned: 0 in 0.520s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5808105-2eff-4033-a8de-01fc683e35bf -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:25 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5808105-2eff-4033-a8de-01fc683e35bf -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 Apr 09 17:36:25 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:25 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb.6e51b000-f64d-4b4e-9313-ec0f1357e67b" returned: 0 in 0.512s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-6e51b000-f64d-4b4e-9313-ec0f1357e67b" released by "_delete_snapshot" :: held 2.306s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" released by "delete_snapshot" :: held 2.320s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (8ae88f8e-5630-4540-8d26-dc45b9e85e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff21ce2-d325-4991-b5ac-277850c0faef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff21ce2-d325-4991-b5ac-277850c0faef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1567321172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f6d966-f232-4b92-b1aa-0bd9ffe885d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1d518e81-2774-49cf-b219-e669e26772dd,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:26Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87834247-1267-4056-8f22-8f895201e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87834247-1267-4056-8f22-8f895201e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b17cf15-1503-4785-ab1e-27f5ea4a3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b17cf15-1503-4785-ab1e-27f5ea4a3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c3f6d966-f232-4b92-b1aa-0bd9ffe885d6', 'volume_name': 'volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6', 'volume_size': 1, 'source_volid': '1d518e81-2774-49cf-b219-e669e26772dd', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed657a-f2c1-4f11-8cc7-8a38fcb42a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed657a-f2c1-4f11-8cc7-8a38fcb42a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25ddcd8-87ef-4639-9079-c0fc223d71e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Volume c3f6d966-f232-4b92-b1aa-0bd9ffe885d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6', 'volume_size': 1, 'source_volid': '1d518e81-2774-49cf-b219-e669e26772dd', 'source_volstatus': 'available'} Apr 09 17:36:25 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5808105-2eff-4033-a8de-01fc683e35bf -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:25 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['0137e417-bf94-4cf2-a3c3-98b547dc6671', 'b6d30258-1dd7-487b-b024-034abda9ee7f', 'd620e1c1-d801-4726-8318-7ecd234079fb', '7214a33c-2427-4688-8ad3-56715ba4bf02'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:25 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 Apr 09 17:36:25 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Flow 'volume_create_manager' (5fc03c5a-358c-403f-98bd-ccab0db5362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ca543e-4dc2-4701-8e9f-121b3f5f1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ca543e-4dc2-4701-8e9f-121b3f5f1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-347052961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6f0237-044a-4980-92bd-b99882564f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49468c3836be412ea484157b8ceb9ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:26Z,use_quota=True,user_id='2aab66e475214fb8abcfba29311f7782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56d8fb9-56ff-4d8e-991f-2e1bdd42ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56d8fb9-56ff-4d8e-991f-2e1bdd42ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f90dd6-79d5-490a-91aa-bc6d8e648cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f90dd6-79d5-490a-91aa-bc6d8e648cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6f0237-044a-4980-92bd-b99882564f9d', 'volume_name': 'volume-af6f0237-044a-4980-92bd-b99882564f9d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824fca3-2d58-4238-b75e-aba1cdf6fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824fca3-2d58-4238-b75e-aba1cdf6fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5c4fd0-b07f-42b5-9ae1-8426154df9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Volume af6f0237-044a-4980-92bd-b99882564f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6f0237-044a-4980-92bd-b99882564f9d', 'volume_size': 1} Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Delete snapshot completed successfully. Apr 09 17:36:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c00982e0-5f6e-4c41-b069-0aa1d38b96be tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-6e51b000-f64d-4b4e-9313-ec0f1357e67b-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:26 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3" returned: 0 in 0.431s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:26 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info Apr 09 17:36:26 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:26 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info" returned: 0 in 0.430s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:26 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:26 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info Apr 09 17:36:26 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (9476e57d-46e1-4d01-b5b8-f1715ed9430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0eb79c-abcc-4986-be7b-7bb7ecf079df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0eb79c-abcc-4986-be7b-7bb7ecf079df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-596554037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:27Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466fb7a-0b39-4ce0-aa6e-e9466500ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466fb7a-0b39-4ce0-aa6e-e9466500ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60dc0aba-1302-4c04-a17c-e3942032d874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60dc0aba-1302-4c04-a17c-e3942032d874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e', 'volume_name': 'volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e6eeba-f507-4964-87ea-7ccd41025875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e6eeba-f507-4964-87ea-7ccd41025875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a56c79-30f8-47bd-9b6e-434aacf19215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Volume 14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e', 'volume_size': 1} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:26 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.info" returned: 0 in 0.391s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.263s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:26 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Cloning volume 1d518e81-2774-49cf-b219-e669e26772dd to volume c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Creating offline snapshot 98213ac0-cfdd-4012-aef5-f17a83e5f18a of volume 1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b25fd26-1067-4d64-97f9-16c28d8f1ff6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:27 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0e4ace15-1ba0-40cf-8527-b9146e62eedf tempest-GroupSnapshotsV319Test-308651635 None] group_snapshot 208c1e17-bc97-44d4-88ae-9821493c79bc: created successfully Apr 09 17:36:27 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:27 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:27 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] group_snapshot 208c1e17-bc97-44d4-88ae-9821493c79bc: deleting Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] group_snapshot 208c1e17-bc97-44d4-88ae-9821493c79bc: deleting {{(pid=82701) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "cinder-quobyte-b5808105-2eff-4033-a8de-01fc683e35bf" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Lock "cinder-quobyte-b5808105-2eff-4033-a8de-01fc683e35bf" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "cinder-quobyte-a1169a4e-bd60-4976-acd7-5c83877231a3" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Lock "cinder-quobyte-a1169a4e-bd60-4976-acd7-5c83877231a3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Deleting offline snapshot a1169a4e-bd60-4976-acd7-5c83877231a3 of volume b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] snapshot_file for this snap is: volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[926932fd-196a-47b4-91e1-2841b1db6c95]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:27 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 0.489s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:27 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a 1G Apr 09 17:36:27 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:27 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 Apr 09 17:36:27 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:27 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3" returned: 0 in 0.504s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5808105-2eff-4033-a8de-01fc683e35bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[36714e1f-d4f5-45fb-b25d-111e6e749bff]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:28 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a 1G" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d518e81-2774-49cf-b219-e669e26772dd -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:28 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d518e81-2774-49cf-b219-e669e26772dd -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a Apr 09 17:36:28 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:28 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf Apr 09 17:36:28 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:28 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d518e81-2774-49cf-b219-e669e26772dd -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a" returned: 0 in 0.408s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:28 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a is being set with open permissions: ugo+rw Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:28 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a Apr 09 17:36:28 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:28 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf" returned: 0 in 0.479s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:28 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 Apr 09 17:36:28 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:28 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a" returned: 0 in 0.442s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:28 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info Apr 09 17:36:28 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:28 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3" returned: 0 in 0.488s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:28 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3 Apr 09 17:36:28 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:29 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info" returned: 0 in 0.417s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:29 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info is being set with open permissions: ugo+rw Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:29 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info Apr 09 17:36:29 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:29 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf.a1169a4e-bd60-4976-acd7-5c83877231a3" returned: 0 in 0.419s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Lock "cinder-quobyte-a1169a4e-bd60-4976-acd7-5c83877231a3" released by "_delete_snapshot" :: held 1.948s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Lock "cinder-quobyte-b5808105-2eff-4033-a8de-01fc683e35bf" released by "delete_snapshot" :: held 1.959s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:29 devstack cinder-volume[82701]: WARNING cinder.quota [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2137593892 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2137593892, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:36:29 devstack cinder-volume[82701]: WARNING cinder.quota [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2137593892 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2137593892, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] Created reservations ['1b04165e-c416-4a19-9082-5f6352b3f937', 'ba87de6f-c387-4327-9dda-9cb08209b639', '9bab3a24-d36d-4c8c-b8e5-320293cdfbe4', '262c4d29-abbf-4fe5-99d9-eddcb08b948c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:29 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a3f248a8-2cac-4a0e-a44e-80284890c0d5 tempest-GroupSnapshotsV319Test-308651635 None] group_snapshot 208c1e17-bc97-44d4-88ae-9821493c79bc: deleted successfully Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "cinder-quobyte-b5808105-2eff-4033-a8de-01fc683e35bf" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Lock "cinder-quobyte-b5808105-2eff-4033-a8de-01fc683e35bf" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b028b78-2d35-4c8c-b67d-9a406d476c16]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:29 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.info" returned: 0 in 0.482s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] snapshot: 98213ac0-cfdd-4012-aef5-f17a83e5f18a, volume: c3f6d966-f232-4b92-b1aa-0bd9ffe885d6, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb557717-c3bd-4c26-a39d-1b9ca7e22020]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:29 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf Apr 09 17:36:29 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:29 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a Apr 09 17:36:29 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:30 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf" returned: 0 in 0.496s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:30 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf Apr 09 17:36:30 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:30 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a" returned: 0 in 0.484s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d518e81-2774-49cf-b219-e669e26772dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[424064c1-7775-4fa6-84f1-364ad004705b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:30 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:30 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:30 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b5808105-2eff-4033-a8de-01fc683e35bf" returned: 0 in 0.408s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Lock "cinder-quobyte-b5808105-2eff-4033-a8de-01fc683e35bf" released by "delete_volume" :: held 0.936s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Created reservations ['22cfcf06-471d-4196-b70d-b677d44e8ea8'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:30 devstack cinder-volume[82701]: WARNING cinder.quota [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2137593892 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2137593892, it is now deprecated. Please use the default quota class for default quota. Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Created reservations ['7655af48-c786-4061-a675-dfeb6c1e34d9', 'c68f2bfd-b8fd-4ce4-8f28-842532a7b5b7', 'b512877c-2da5-4db6-8377-acf3dfda3108', '0b2d85b1-ad79-4098-a0a9-f359822b7bbd'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:30 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:30 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:30 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 0.533s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:36:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:30 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 Apr 09 17:36:30 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:31 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.513s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:31 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:31 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d4c7c21c-91f1-4279-b6d0-b7c15b18b3ac tempest-GroupSnapshotsV319Test-308651635 None] Delete group completed successfully. Apr 09 17:36:33 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" returned: 0 in 2.227s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc5bdfe-d276-4a01-b277-0eac54c7dc2c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:33 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:33 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:33 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 0.631s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:33 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:36:33 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Converted 1024.00 MB image at 459.41 MB/s Apr 09 17:36:33 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 is being set with open permissions: ugo+rw Apr 09 17:36:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:33 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 Apr 09 17:36:33 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:34 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" returned: 0 in 0.453s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" released by "_copy_volume_from_snapshot" :: held 4.380s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-98213ac0-cfdd-4012-aef5-f17a83e5f18a" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-98213ac0-cfdd-4012-aef5-f17a83e5f18a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Deleting offline snapshot 98213ac0-cfdd-4012-aef5-f17a83e5f18a of volume 1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] snapshot_file for this snap is: volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99ca52c-4c32-476c-8501-2311beeeaffc]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:34 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a Apr 09 17:36:34 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:34 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a" returned: 0 in 0.546s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d518e81-2774-49cf-b219-e669e26772dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca8f7b4-af6d-4ee1-b1c5-d40bdc5092f5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:34 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:34 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:35 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 0.524s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:35 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a Apr 09 17:36:35 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:35 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a" returned: 0 in 0.527s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:35 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a Apr 09 17:36:35 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:36 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd.98213ac0-cfdd-4012-aef5-f17a83e5f18a" returned: 0 in 0.462s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-98213ac0-cfdd-4012-aef5-f17a83e5f18a" released by "_delete_snapshot" :: held 2.111s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.377s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.536s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-347052961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6f0237-044a-4980-92bd-b99882564f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49468c3836be412ea484157b8ceb9ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:26Z,use_quota=True,user_id='2aab66e475214fb8abcfba29311f7782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Creating volume af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:36 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:36 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d 1073741824 Apr 09 17:36:36 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25ddcd8-87ef-4639-9079-c0fc223d71e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6', 'volume_size': 1, 'source_volid': '1d518e81-2774-49cf-b219-e669e26772dd', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d5e852-011a-439b-a644-39187cb8f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:36 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Volume volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 (c3f6d966-f232-4b92-b1aa-0bd9ffe885d6): created successfully Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d5e852-011a-439b-a644-39187cb8f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (8ae88f8e-5630-4540-8d26-dc45b9e85e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-76c0c28a-8e13-4df3-aef2-94bcf2fd41c0 tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:36:36 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d 1073741824" returned: 0 in 0.543s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:36 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:36 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:37 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.765s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-596554037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:27Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Creating volume 14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:37 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5c4fd0-b07f-42b5-9ae1-8426154df9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6f0237-044a-4980-92bd-b99882564f9d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4afb5f3-0da2-494f-97ef-22fb80fb3d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:37 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e 1073741824 Apr 09 17:36:37 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:37 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Volume volume-af6f0237-044a-4980-92bd-b99882564f9d (af6f0237-044a-4980-92bd-b99882564f9d): created successfully Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4afb5f3-0da2-494f-97ef-22fb80fb3d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Flow 'volume_create_manager' (5fc03c5a-358c-403f-98bd-ccab0db5362b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:37 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8d4d59c6-7116-4694-85d7-ee51fc15aef0 tempest-VolumesCloneTest-184652643 None] Created volume successfully. Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (17d2d1c8-cf1e-4d88-a7b9-361bac5ad8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6bef6a-5229-446b-b950-9bf4301abb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6bef6a-5229-446b-b950-9bf4301abb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1350683483',display_name='tempest-VolumesGetTest-Volume-1567876836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c17ef3-0ee7-497d-8d46-b330162e5526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:38Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e647034-e6e6-4098-9652-8336cdaef3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e647034-e6e6-4098-9652-8336cdaef3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be16a4a-640d-4b24-b4e2-4e9b02256a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be16a4a-640d-4b24-b4e2-4e9b02256a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c17ef3-0ee7-497d-8d46-b330162e5526', 'volume_name': 'volume-33c17ef3-0ee7-497d-8d46-b330162e5526', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7df6dc-9d25-49af-b086-5b5140be5225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7df6dc-9d25-49af-b086-5b5140be5225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57836b80-d877-44a0-bcd1-6c92db325d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:37 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Volume 33c17ef3-0ee7-497d-8d46-b330162e5526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c17ef3-0ee7-497d-8d46-b330162e5526', 'volume_size': 1} Apr 09 17:36:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:38 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e 1073741824" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:38 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:36:38 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:38 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.443s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1350683483',display_name='tempest-VolumesGetTest-Volume-1567876836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c17ef3-0ee7-497d-8d46-b330162e5526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:38Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Creating volume 33c17ef3-0ee7-497d-8d46-b330162e5526 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:38 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a56c79-30f8-47bd-9b6e-434aacf19215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591e153d-7cc0-40e2-8f08-6300cb9a30fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:38 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 1073741824 Apr 09 17:36:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Volume volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e (14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e): created successfully Apr 09 17:36:38 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591e153d-7cc0-40e2-8f08-6300cb9a30fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (9476e57d-46e1-4d01-b5b8-f1715ed9430b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cd0d8496-1a73-4b7b-9f0b-4d9cec72217c tempest-VolumesSnapshotTestJSON-258885215 None] Created volume successfully. Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Flow 'volume_create_manager' (b990245a-65a9-4da8-ab7d-9b9ad10637fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd0fa66-d824-4c4b-b906-f6fe04c099d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd0fa66-d824-4c4b-b906-f6fe04c099d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-187380577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59999705-3a9f-4589-9065-f621dd1d35cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49468c3836be412ea484157b8ceb9ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=af6f0237-044a-4980-92bd-b99882564f9d,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:39Z,use_quota=True,user_id='2aab66e475214fb8abcfba29311f7782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4139a91-c77b-44f6-8148-dd1011864a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4139a91-c77b-44f6-8148-dd1011864a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e304c1da-35b0-4be9-9780-90b0f412fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e304c1da-35b0-4be9-9780-90b0f412fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '59999705-3a9f-4589-9065-f621dd1d35cb', 'volume_name': 'volume-59999705-3a9f-4589-9065-f621dd1d35cb', 'volume_size': 2, 'source_volid': 'af6f0237-044a-4980-92bd-b99882564f9d', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9a5c10-dc88-45b0-ad6a-b0742e59651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9a5c10-dc88-45b0-ad6a-b0742e59651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c137fe-06e7-4b89-b440-15903351372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Volume 59999705-3a9f-4589-9065-f621dd1d35cb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-59999705-3a9f-4589-9065-f621dd1d35cb', 'volume_size': 2, 'source_volid': 'af6f0237-044a-4980-92bd-b99882564f9d', 'source_volstatus': 'available'} Apr 09 17:36:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:39 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 1073741824" returned: 0 in 0.578s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:39 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 Apr 09 17:36:39 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:39 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526" returned: 0 in 0.466s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.762s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:39 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Cloning volume af6f0237-044a-4980-92bd-b99882564f9d to volume 59999705-3a9f-4589-9065-f621dd1d35cb Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57836b80-d877-44a0-bcd1-6c92db325d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c17ef3-0ee7-497d-8d46-b330162e5526', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57b0b33-a0e0-45e1-a952-686b8238a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:39 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Volume volume-33c17ef3-0ee7-497d-8d46-b330162e5526 (33c17ef3-0ee7-497d-8d46-b330162e5526): created successfully Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57b0b33-a0e0-45e1-a952-686b8238a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (17d2d1c8-cf1e-4d88-a7b9-361bac5ad8dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Creating offline snapshot 0905ea69-041f-4573-9d4c-a87834772d5e of volume af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:36:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b624529d-a902-443f-abac-20f084849af8 tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ed9ee-0da8-4071-8433-b150ae48197f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:39 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:39 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-33c17ef3-0ee7-497d-8d46-b330162e5526-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Lock "cinder-33c17ef3-0ee7-497d-8d46-b330162e5526-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-33c17ef3-0ee7-497d-8d46-b330162e5526" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-33c17ef3-0ee7-497d-8d46-b330162e5526" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaba6244-153b-4e78-8364-557263c4d116]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:40 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 Apr 09 17:36:40 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:40 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.540s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:40 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e 1G Apr 09 17:36:40 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:40 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526" returned: 0 in 0.541s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:40 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526 Apr 09 17:36:40 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:40 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e 1G" returned: 0 in 0.532s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af6f0237-044a-4980-92bd-b99882564f9d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:40 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af6f0237-044a-4980-92bd-b99882564f9d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e Apr 09 17:36:40 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:41 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-33c17ef3-0ee7-497d-8d46-b330162e5526" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-33c17ef3-0ee7-497d-8d46-b330162e5526" released by "delete_volume" :: held 1.077s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=120,cinder:INSERT=32,cinder:UPDATE=124,cinder:DELETE=7 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Created reservations ['03ae6a2a-81ce-4456-b3c6-d134d5d4c7ca', '2aa06f87-7685-47c9-be67-e02b9770ff80', 'bffa4f46-8d72-4ce6-964d-51843984a2c7', '85c8c5c7-9a3f-46ec-8a78-c3ea19907e3b'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:41 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af6f0237-044a-4980-92bd-b99882564f9d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e" returned: 0 in 0.515s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:41 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e is being set with open permissions: ugo+rw Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:41 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:41 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:41 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e Apr 09 17:36:41 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:41 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.485s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:36:41 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2fd8eb3-9e72-466e-b8a9-5ab61ce52802 tempest-VolumesGetTest-1239197335 None] Lock "cinder-33c17ef3-0ee7-497d-8d46-b330162e5526-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:41 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info Apr 09 17:36:41 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:42 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:42 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info is being set with open permissions: ugo+rw Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:42 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info Apr 09 17:36:42 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Lock "cinder-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a98ec6e-8c5f-43d1-96b6-bc6eb71c2fcf]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:42 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 Apr 09 17:36:42 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:42 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.info" returned: 0 in 0.486s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Acquiring lock "cinder-quobyte-59999705-3a9f-4589-9065-f621dd1d35cb" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-59999705-3a9f-4589-9065-f621dd1d35cb" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] snapshot: 0905ea69-041f-4573-9d4c-a87834772d5e, volume: 59999705-3a9f-4589-9065-f621dd1d35cb, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e97b3b-e509-430d-a10f-20b54913bd91]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:42 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e Apr 09 17:36:42 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:42 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" returned: 0 in 0.566s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:42 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6 Apr 09 17:36:42 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:43 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e" returned: 0 in 0.539s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af6f0237-044a-4980-92bd-b99882564f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[007bb445-25db-4095-b415-5ec784af7cc5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:43 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6" released by "delete_volume" :: held 1.027s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Created reservations ['712e83b7-385e-4394-96a5-28358e7d62f1', 'c4cac6da-e4d4-40f7-8560-545888b51cc2', '280f8f55-ec4a-4dba-b395-8fc8ef9e2f15', '0aa76674-895d-4657-946d-3964bd2a537d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:43 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:43 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:43 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:43 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:43 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.532s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:43 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb Apr 09 17:36:43 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:43 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:36:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bdca7e19-b0ee-46e2-a9a2-01064999212e tempest-VolumesGetTest-1239197335 None] Lock "cinder-c3f6d966-f232-4b92-b1aa-0bd9ffe885d6-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-1d518e81-2774-49cf-b219-e669e26772dd-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Lock "cinder-1d518e81-2774-49cf-b219-e669e26772dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-1d518e81-2774-49cf-b219-e669e26772dd" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-1d518e81-2774-49cf-b219-e669e26772dd" acquired by "delete_volume" :: waited 0.057s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:44 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6adfff-9a14-4853-b38d-a1de4889b4b5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:45 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:45 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:46 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 1.155s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:46 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd Apr 09 17:36:46 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:46 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb" returned: 0 in 2.516s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc555ff8-70ca-42f5-9e3f-1547a614e412]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:46 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:46 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:46 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1d518e81-2774-49cf-b219-e669e26772dd" returned: 0 in 0.543s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-1d518e81-2774-49cf-b219-e669e26772dd" released by "delete_volume" :: held 1.791s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Created reservations ['8c3c63a8-85f6-4652-9f68-adfa08f4fa6d', 'd6ccd0a5-815f-4c9b-9f57-f200b96a5772', 'ac7e3973-2914-4669-9791-901e774ba62a', 'c6c84279-db84-441b-bccf-9e16921ba1a6'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:46 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:46 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:47 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.707s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:36:47 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Converted 1024.00 MB image at 406.84 MB/s Apr 09 17:36:47 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb is being set with open permissions: ugo+rw Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:47 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb Apr 09 17:36:47 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:47 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.560s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-21ae2a95-6156-4f47-949f-9c689c47fba9 tempest-VolumesGetTest-1239197335 None] Lock "cinder-1d518e81-2774-49cf-b219-e669e26772dd-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (86e3389e-3534-4eda-b10d-e9119188319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d6a444-2ec9-48d8-8fb8-f5bd50dfe98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d6a444-2ec9-48d8-8fb8-f5bd50dfe98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1199986518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332a739-b4f4-43dd-85a8-bc1f8f806751,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:47Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3056dbd5-0a80-4421-a72e-b25b98c8d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3056dbd5-0a80-4421-a72e-b25b98c8d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc7936e-c74e-44f4-a098-a2356158405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.image.glance [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Creating Keystone auth plugin from conf {{(pid=82701) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 17:36:47 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-59999705-3a9f-4589-9065-f621dd1d35cb" released by "_copy_volume_from_snapshot" :: held 4.915s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Acquiring lock "cinder-quobyte-0905ea69-041f-4573-9d4c-a87834772d5e" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-0905ea69-041f-4573-9d4c-a87834772d5e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Deleting offline snapshot 0905ea69-041f-4573-9d4c-a87834772d5e of volume af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] snapshot_file for this snap is: volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575b281-d2e1-44cb-9e88-b390bde2cdcb]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc7936e-c74e-44f4-a098-a2356158405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0332a739-b4f4-43dd-85a8-bc1f8f806751', 'volume_name': 'volume-0332a739-b4f4-43dd-85a8-bc1f8f806751', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a683fe-2fa6-4550-8d25-d35f5b369889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a683fe-2fa6-4550-8d25-d35f5b369889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6b0478-8bb6-4578-a5c7-d7801d5d7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:47 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Volume 0332a739-b4f4-43dd-85a8-bc1f8f806751: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0332a739-b4f4-43dd-85a8-bc1f8f806751', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Trying to clone 0332a739-b4f4-43dd-85a8-bc1f8f806751 from image e1c6f14c-6844-4aad-9551-57f242d39ddc at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]). {{(pid=82701) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 17:36:47 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e Apr 09 17:36:47 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 17:36:47 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Image download 20.69 MB at 20.69 MB/s Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e44fb6-881b-4957-86f3-b320518da909]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:48 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD Apr 09 17:36:48 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:48 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e" returned: 0 in 0.650s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af6f0237-044a-4980-92bd-b99882564f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4aaafd-75d3-4ed5-bfbb-e0972f5d545f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:48 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:48 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:48 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc is fetched for user 4994a3dcddef4eb6b05b18224b6fde05. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f8229-f688-4c6e-9a5d-3154c6483f84]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:48 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD Apr 09 17:36:48 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:48 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.623s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:48 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e Apr 09 17:36:48 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:49 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:49 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:49 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e Apr 09 17:36:49 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:49 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d.0905ea69-041f-4573-9d4c-a87834772d5e" returned: 0 in 0.444s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-0905ea69-041f-4573-9d4c-a87834772d5e" released by "_delete_snapshot" :: held 2.352s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.404s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.501s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Creating offline snapshot fa21c9fa-07ef-47a2-8148-53aa95b03290 of volume 14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c137fe-06e7-4b89-b440-15903351372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59999705-3a9f-4589-9065-f621dd1d35cb', 'volume_size': 2, 'source_volid': 'af6f0237-044a-4980-92bd-b99882564f9d', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b017f8b-a976-4ab5-9dd8-0046e0b1e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f318afe-9ff7-4983-b46f-f2ce78bc1a6f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:50 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Volume volume-59999705-3a9f-4589-9065-f621dd1d35cb (59999705-3a9f-4589-9065-f621dd1d35cb): created successfully Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b017f8b-a976-4ab5-9dd8-0046e0b1e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Flow 'volume_create_manager' (b990245a-65a9-4da8-ab7d-9b9ad10637fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:50 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0816f998-06ed-4265-a541-1947ac70fd0e tempest-VolumesCloneTest-184652643 None] Created volume successfully. Apr 09 17:36:50 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:36:50 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:50 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.603s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:50 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 1G Apr 09 17:36:50 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Acquiring lock "cinder-59999705-3a9f-4589-9065-f621dd1d35cb-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Lock "cinder-59999705-3a9f-4589-9065-f621dd1d35cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Acquiring lock "cinder-quobyte-59999705-3a9f-4589-9065-f621dd1d35cb" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-59999705-3a9f-4589-9065-f621dd1d35cb" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[42828f53-0aff-4013-aed3-aeb21fe5a243]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:50 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb Apr 09 17:36:50 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:51 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 1G" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:51 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 Apr 09 17:36:51 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:51 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb" returned: 0 in 0.595s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:51 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb Apr 09 17:36:51 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:51 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290" returned: 0 in 0.530s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:51 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 is being set with open permissions: ugo+rw Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:51 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 Apr 09 17:36:51 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:51 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-59999705-3a9f-4589-9065-f621dd1d35cb" returned: 0 in 0.564s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-59999705-3a9f-4589-9065-f621dd1d35cb" released by "delete_volume" :: held 1.200s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:51 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Created reservations ['45dfa99c-65a8-4e54-b40b-e4a5e6dbe61b', '95eec36a-b277-4e94-b2fd-9190ca7ad048', 'd4e7e7a1-ad93-4ddf-b17f-ee4c9260dd63', '6a4c4856-d282-41f1-9752-f3762a2a368b'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:52 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:52 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:52 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290" returned: 0 in 0.515s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:52 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info Apr 09 17:36:52 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:52 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:52 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Deleted volume successfully. Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f8df608c-2956-4d20-b5ab-b7a3f00035e5 tempest-VolumesCloneTest-184652643 None] Lock "cinder-59999705-3a9f-4589-9065-f621dd1d35cb-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:52 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:52 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info is being set with open permissions: ugo+rw Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:52 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info Apr 09 17:36:52 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Acquiring lock "cinder-af6f0237-044a-4980-92bd-b99882564f9d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Lock "cinder-af6f0237-044a-4980-92bd-b99882564f9d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Acquiring lock "cinder-quobyte-af6f0237-044a-4980-92bd-b99882564f9d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-af6f0237-044a-4980-92bd-b99882564f9d" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[062d6346-abd3-4433-9bc6-886481794df2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:53 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:53 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:53 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.info" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.087s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1199986518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332a739-b4f4-43dd-85a8-bc1f8f806751,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:47Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Creating volume 0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:53 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:53 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 1073741824 Apr 09 17:36:53 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5b83462f-05ad-480c-89c2-2712de6f88bb tempest-VolumesSnapshotTestJSON-258885215 None] Create snapshot completed successfully Apr 09 17:36:53 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.526s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:53 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d Apr 09 17:36:53 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:53 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 1073741824" returned: 0 in 0.553s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:53 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:36:53 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:53 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-af6f0237-044a-4980-92bd-b99882564f9d" returned: 0 in 0.468s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Lock "cinder-quobyte-af6f0237-044a-4980-92bd-b99882564f9d" released by "delete_volume" :: held 1.032s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Created reservations ['2f2a0cfb-0331-430b-bf7d-1f93ee8ad1a4', '6a0938bd-47e4-43e9-b62e-26ce613aafe1', 'da628f27-5a7f-4039-ab06-3d92196f32c1', '71cffbaa-f13b-4533-82a3-c96370e2cb77'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:54 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:36:54 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:54 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (08f45a75-17d7-4534-bbe2-4251dd76b2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a156b9d8-2f68-499d-a997-dbd6b6b48a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 0 in 0.585s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a156b9d8-2f68-499d-a997-dbd6b6b48a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2047315959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa6e43f-b0ab-4a78-b87f-32d445d8566a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fa21c9fa-07ef-47a2-8148-53aa95b03290,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:54Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e3bd0b-5ee2-45ba-99f1-520fa52c17e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e3bd0b-5ee2-45ba-99f1-520fa52c17e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa1539e-2d0c-4168-b8e5-6b10ce133ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa1539e-2d0c-4168-b8e5-6b10ce133ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'faa6e43f-b0ab-4a78-b87f-32d445d8566a', 'volume_name': 'volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a', 'volume_size': 2, 'snapshot_id': 'fa21c9fa-07ef-47a2-8148-53aa95b03290'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6809e6f-3223-46c7-aeca-80bc989e574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6809e6f-3223-46c7-aeca-80bc989e574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b488db13-dd27-4851-9c47-a4e9f4203ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Volume faa6e43f-b0ab-4a78-b87f-32d445d8566a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a', 'volume_size': 2, 'snapshot_id': 'fa21c9fa-07ef-47a2-8148-53aa95b03290'} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-fa21c9fa-07ef-47a2-8148-53aa95b03290-faa6e43f-b0ab-4a78-b87f-32d445d8566a" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Attempting download of e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume 0332a739-b4f4-43dd-85a8-bc1f8f806751. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-fa21c9fa-07ef-47a2-8148-53aa95b03290-faa6e43f-b0ab-4a78-b87f-32d445d8566a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Creating volume faa6e43f-b0ab-4a78-b87f-32d445d8566a from snapshot fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-faa6e43f-b0ab-4a78-b87f-32d445d8566a" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-faa6e43f-b0ab-4a78-b87f-32d445d8566a" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] snapshot: fa21c9fa-07ef-47a2-8148-53aa95b03290, volume: faa6e43f-b0ab-4a78-b87f-32d445d8566a, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed8052a-4ad5-4eba-ae24-ae7631ce3a2e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[86703cab-08fd-46ce-930a-28816add8b8e]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:54 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf Apr 09 17:36:54 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:54 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 Apr 09 17:36:54 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:54 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.560s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:36:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Deleted volume successfully. Apr 09 17:36:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6935556c-bd54-47af-80a9-46e3b244a83e tempest-VolumesCloneTest-184652643 None] Lock "cinder-af6f0237-044a-4980-92bd-b99882564f9d-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:36:55 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf" returned: 0 in 0.504s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:55 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf Apr 09 17:36:55 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:55 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290" returned: 0 in 0.610s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d72c02-11d2-4f29-83c4-b26596ae44d9]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:55 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:36:55 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:55 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf" returned: 1 in 0.680s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1c6f14c-6844-4aad-9551-57f242d39ddc_j5z6p_vf' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ac62d-0511-44b8-9d91-66b42758c53e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:55 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD Apr 09 17:36:55 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:55 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.753s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:36:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:55 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a Apr 09 17:36:55 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:56 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:56 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] e1c6f14c-6844-4aad-9551-57f242d39ddc was qcow2, converting to raw {{(pid=82701) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 17:36:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:56 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:36:56 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:58 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a" returned: 0 in 2.937s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d079ad9f-1570-4db4-9db4-2aee75f5451b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:58 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:36:58 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:58 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 0 in 2.562s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:58 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1c6f14c-6844-4aad-9551-57f242d39ddc_3g4q5rsgdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:36:58 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Converted 112.00 MB image at 43.70 MB/s Apr 09 17:36:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:58 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 1G Apr 09 17:36:58 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Flow 'volume_create_manager' (1b675d39-329c-4f74-941a-25983298d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd7556-3ba9-49b9-a9cc-aa2c0c516bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd7556-3ba9-49b9-a9cc-aa2c0c516bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-166643723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91de8b83-7650-46d7-8ac4-b5504198f7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb6e174c6304591a71fca853797ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:59Z,use_quota=True,user_id='aecb7d0ebf22472c96551c74d21cb40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1aae28c-3d0e-4d87-b375-1b1bf16af5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1aae28c-3d0e-4d87-b375-1b1bf16af5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7d707d-3ee2-4f5d-bea7-b2779225499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7d707d-3ee2-4f5d-bea7-b2779225499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91de8b83-7650-46d7-8ac4-b5504198f7b3', 'volume_name': 'volume-91de8b83-7650-46d7-8ac4-b5504198f7b3', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b9e2fa-fe94-4b97-8155-23b4aaa43396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b9e2fa-fe94-4b97-8155-23b4aaa43396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7d72af-fbd2-4ad5-98cb-e552442798b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:36:59 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Volume 91de8b83-7650-46d7-8ac4-b5504198f7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91de8b83-7650-46d7-8ac4-b5504198f7b3', 'volume_size': 1} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:36:59 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 1G" returned: 0 in 0.659s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2208a74-a5ba-4d83-8fc7-2f362020339e]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:59 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:36:59 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:36:59 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.919s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e, size 1024.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:36:59 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Converted 1024.00 MB image at 348.52 MB/s Apr 09 17:36:59 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a is being set with open permissions: ugo+rw Apr 09 17:36:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:36:59 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a Apr 09 17:36:59 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:00 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 0 in 0.614s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:00 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a" returned: 0 in 0.512s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-faa6e43f-b0ab-4a78-b87f-32d445d8566a" released by "_copy_volume_from_snapshot" :: held 5.798s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-fa21c9fa-07ef-47a2-8148-53aa95b03290-faa6e43f-b0ab-4a78-b87f-32d445d8566a" released by "_create_volume_from_snapshot" :: held 5.813s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.832s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-166643723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91de8b83-7650-46d7-8ac4-b5504198f7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb6e174c6304591a71fca853797ccd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:36:59Z,use_quota=True,user_id='aecb7d0ebf22472c96551c74d21cb40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Creating volume 91de8b83-7650-46d7-8ac4-b5504198f7b3 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:00 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:00 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:37:00 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:00 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 1073741824 Apr 09 17:37:00 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b488db13-dd27-4851-9c47-a4e9f4203ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a', 'volume_size': 2, 'snapshot_id': 'fa21c9fa-07ef-47a2-8148-53aa95b03290'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de007ce8-4027-499c-9457-f716ee7d404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:00 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Volume volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a (faa6e43f-b0ab-4a78-b87f-32d445d8566a): created successfully Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de007ce8-4027-499c-9457-f716ee7d404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (08f45a75-17d7-4534-bbe2-4251dd76b2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-24dc03b2-3617-4c0c-9789-4f6698ba9b97 tempest-VolumesSnapshotTestJSON-258885215 None] Created volume successfully. Apr 09 17:37:00 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 1 in 0.580s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Downloaded image e1c6f14c-6844-4aad-9551-57f242d39ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}])) to volume 0332a739-b4f4-43dd-85a8-bc1f8f806751 successfully. {{(pid=82701) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Temporary image e1c6f14c-6844-4aad-9551-57f242d39ddc for user 4994a3dcddef4eb6b05b18224b6fde05 is deleted. {{(pid=82701) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.volume_utils [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Marking volume 0332a739-b4f4-43dd-85a8-bc1f8f806751 as bootable. {{(pid=82701) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Copying metadata from image e1c6f14c-6844-4aad-9551-57f242d39ddc to 0332a739-b4f4-43dd-85a8-bc1f8f806751. {{(pid=82701) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Creating volume glance metadata for volume 0332a739-b4f4-43dd-85a8-bc1f8f806751 backed by image e1c6f14c-6844-4aad-9551-57f242d39ddc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82701) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6b0478-8bb6-4578-a5c7-d7801d5d7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0332a739-b4f4-43dd-85a8-bc1f8f806751', 'volume_size': 1, 'image_id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1c6f14c-6844-4aad-9551-57f242d39ddc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81433147374649f682038b897c691727', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1c6f14c-6844-4aad-9551-57f242d39ddc', 'created_at': datetime.datetime(2026, 4, 9, 15, 27, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 15, 27, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1c6f14c-6844-4aad-9551-57f242d39ddc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19f556a-928b-4bcc-9563-d6e7179f8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:00 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Volume volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 (0332a739-b4f4-43dd-85a8-bc1f8f806751): created successfully Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19f556a-928b-4bcc-9563-d6e7179f8be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (86e3389e-3534-4eda-b10d-e9119188319e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-357ae894-a13e-4048-a08c-b6e8cb6dcb9c tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:37:00 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 1073741824" returned: 0 in 0.627s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:00 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 Apr 09 17:37:00 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-faa6e43f-b0ab-4a78-b87f-32d445d8566a-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-faa6e43f-b0ab-4a78-b87f-32d445d8566a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-faa6e43f-b0ab-4a78-b87f-32d445d8566a" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-faa6e43f-b0ab-4a78-b87f-32d445d8566a" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[959dcaa1-bba6-4046-8b14-ca8a4b95988b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:01 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a Apr 09 17:37:01 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:01 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7d72af-fbd2-4ad5-98cb-e552442798b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91de8b83-7650-46d7-8ac4-b5504198f7b3', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5993ba9a-d686-47d4-a84f-1700008c1e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:01 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Volume volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 (91de8b83-7650-46d7-8ac4-b5504198f7b3): created successfully Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5993ba9a-d686-47d4-a84f-1700008c1e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Flow 'volume_create_manager' (1b675d39-329c-4f74-941a-25983298d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:01 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-06377c40-ceff-4f2d-8b37-2dae613d7188 tempest-VolumesNegativeTest-1357997287 None] Created volume successfully. Apr 09 17:37:01 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:01 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a Apr 09 17:37:01 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (13556b09-6993-412d-bdca-5c39b601293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42731863-c057-4b6f-9d7e-3258a17e7542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42731863-c057-4b6f-9d7e-3258a17e7542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-294028332',display_name='tempest-VolumesGetTest-Volume-806345399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5526ee-628e-4a83-b23c-87de92b5e8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:02Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e071bb0-3ae6-486f-ace1-fe3cf0ae16f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e071bb0-3ae6-486f-ace1-fe3cf0ae16f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d729b9-724e-4105-abaa-0f0346f37f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d729b9-724e-4105-abaa-0f0346f37f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5526ee-628e-4a83-b23c-87de92b5e8ba', 'volume_name': 'volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cfd296-87ad-4266-97a6-d7618b38ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cfd296-87ad-4266-97a6-d7618b38ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2adca6-0ff3-4b41-b16e-7e9d59f91e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:02 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Volume 3b5526ee-628e-4a83-b23c-87de92b5e8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba', 'volume_size': 1} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-294028332',display_name='tempest-VolumesGetTest-Volume-806345399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5526ee-628e-4a83-b23c-87de92b5e8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cb97a7408841e4a8c656cc077b1668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:02Z,use_quota=True,user_id='4994a3dcddef4eb6b05b18224b6fde05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Creating volume 3b5526ee-628e-4a83-b23c-87de92b5e8ba {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:02 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:02 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba 1073741824 Apr 09 17:37:02 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:02 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-faa6e43f-b0ab-4a78-b87f-32d445d8566a" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-faa6e43f-b0ab-4a78-b87f-32d445d8566a" released by "delete_volume" :: held 1.058s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['18e0ca9c-edf1-495e-a265-d863f5ce0ccd', 'f6748c1d-df37-4bbf-801f-599982f28586', '49f3e732-ae1c-4c6f-8295-8d2105405067', '184bfe34-bd33-4f11-a9cb-5e0432a6455e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:02 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:02 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:02 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba 1073741824" returned: 0 in 0.595s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:02 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.457s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:02 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Deleted volume successfully. Apr 09 17:37:02 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba Apr 09 17:37:02 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8eab4176-1bfa-455a-83ad-dbe32e692a45 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-faa6e43f-b0ab-4a78-b87f-32d445d8566a-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:03 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba" returned: 0 in 0.464s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2adca6-0ff3-4b41-b16e-7e9d59f91e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc918df-8b5f-4983-b0ac-428c72b90015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:03 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Volume volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba (3b5526ee-628e-4a83-b23c-87de92b5e8ba): created successfully Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc918df-8b5f-4983-b0ac-428c72b90015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Flow 'volume_create_manager' (13556b09-6993-412d-bdca-5c39b601293b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:03 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7f973fe3-48a2-4ae8-baad-5faa90892121 tempest-VolumesGetTest-1239197335 None] Created volume successfully. Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-fa21c9fa-07ef-47a2-8148-53aa95b03290-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-fa21c9fa-07ef-47a2-8148-53aa95b03290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-fa21c9fa-07ef-47a2-8148-53aa95b03290" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-fa21c9fa-07ef-47a2-8148-53aa95b03290" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Deleting offline snapshot fa21c9fa-07ef-47a2-8148-53aa95b03290 of volume 14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] snapshot_file for this snap is: volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44861a4-b992-499c-8ef4-0866d387faea]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:03 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 Apr 09 17:37:03 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:03 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290" returned: 0 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c444626-a734-4dd6-9b59-297499b76bcc]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:03 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:37:03 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-3b5526ee-628e-4a83-b23c-87de92b5e8ba-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Lock "cinder-3b5526ee-628e-4a83-b23c-87de92b5e8ba-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-3b5526ee-628e-4a83-b23c-87de92b5e8ba" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-3b5526ee-628e-4a83-b23c-87de92b5e8ba" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cbd1b3-3de9-4770-8ff1-6a857fe1db62]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:04 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba Apr 09 17:37:04 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:04 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.600s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:04 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 Apr 09 17:37:04 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:04 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba" returned: 0 in 0.553s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:04 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba Apr 09 17:37:04 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:04 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290" returned: 0 in 0.545s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:04 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290 Apr 09 17:37:04 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:05 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3b5526ee-628e-4a83-b23c-87de92b5e8ba" returned: 0 in 0.491s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-3b5526ee-628e-4a83-b23c-87de92b5e8ba" released by "delete_volume" :: held 1.070s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Created reservations ['e7808acd-e3ac-4fa5-afe6-e4e591fb7450', '4a30f65b-77b6-45ed-b05b-97e18f86f1b7', 'b9eed834-6899-4f57-a408-7ee77fec2a29', '6baba6ae-6187-4065-8d7d-2a381f432e1d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:05 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:05 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:05 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e.fa21c9fa-07ef-47a2-8148-53aa95b03290" returned: 0 in 0.516s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-fa21c9fa-07ef-47a2-8148-53aa95b03290" released by "_delete_snapshot" :: held 2.216s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" released by "delete_snapshot" :: held 2.234s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['50bfa8f9-f601-476f-88d2-9c491b6174da', '7d2df401-12d8-4599-8ae2-dde8a6b8a294', 'f36a0d9c-2147-403f-b14b-560c96db8baf', '8a6cd316-d237-426b-b0d7-e08a25a15d5c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Delete snapshot completed successfully. Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1cab81c2-58ab-445d-ae6b-3ba01578e17c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-fa21c9fa-07ef-47a2-8148-53aa95b03290-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:05 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.483s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:37:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8f4a61f2-bd20-4c4b-982e-2bc25526cd36 tempest-VolumesGetTest-1239197335 None] Lock "cinder-3b5526ee-628e-4a83-b23c-87de92b5e8ba-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-0332a739-b4f4-43dd-85a8-bc1f8f806751-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Lock "cinder-0332a739-b4f4-43dd-85a8-bc1f8f806751-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=141,cinder:UPDATE=153,cinder:DELETE=14,cinder:INSERT=41 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Acquiring lock "cinder-quobyte-0332a739-b4f4-43dd-85a8-bc1f8f806751" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9be512-a43c-403d-a16b-d2a9809123ba]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-0332a739-b4f4-43dd-85a8-bc1f8f806751" acquired by "delete_volume" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[138d4f78-d06c-44b9-a85b-514eeee7a01c]: (4, 'raw') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:06 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:37:06 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:06 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:37:06 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:07 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.498s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:07 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e Apr 09 17:37:07 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:07 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 0 in 0.570s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:07 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:37:07 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:07 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" returned: 0 in 0.487s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e" released by "delete_volume" :: held 1.024s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['0dc2b4c2-9c8f-4cae-8833-61bb702eec77', '359e906b-78f7-4c39-a70f-c1275af6cc83', '52858332-f20f-44d1-8e62-5846606ac58d', '09f712e3-869c-4552-bc91-79f7f3bd960c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:07 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:07 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:07 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 1 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751' failed. Not Retrying. {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 17:37:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:07 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751 Apr 09 17:37:07 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:08 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.478s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:08 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Deleted volume successfully. Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3f3a9092-36e1-46cd-be2d-08bd7c7e277a tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-14bbcfa2-7a2e-47c0-88f1-3b36d8e36e0e-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:08 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:08 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:08 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0332a739-b4f4-43dd-85a8-bc1f8f806751" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Lock "cinder-quobyte-0332a739-b4f4-43dd-85a8-bc1f8f806751" released by "delete_volume" :: held 1.769s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Created reservations ['23996800-39ec-4e00-9e75-3e5702b5fcc9', '28d30ef8-b974-4223-b99d-9964fcecfdfe', '297e3027-7fab-4106-b734-dbcc73cb8e27', '41c707d2-fc2c-48e0-bbb7-7663b2af5d87'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:08 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:08 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:08 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.666s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:09 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.634s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:09 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Deleted volume successfully. Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8906f1e0-dc03-41be-a5a1-cb164628e81f tempest-VolumesGetTest-1239197335 None] Lock "cinder-0332a739-b4f4-43dd-85a8-bc1f8f806751-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (39cfbb30-4431-4f24-8bb4-904dea48fe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be41919-845c-47a4-b5a1-0f35f518594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be41919-845c-47a4-b5a1-0f35f518594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-80408809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f930ff-9209-465e-bd18-a01385f91ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:09Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f6e03d-1fcd-485d-8bc5-8aca1eb272fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f6e03d-1fcd-485d-8bc5-8aca1eb272fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec7a013-b0eb-4c99-af06-9d6cc0a9be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec7a013-b0eb-4c99-af06-9d6cc0a9be69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f930ff-9209-465e-bd18-a01385f91ad2', 'volume_name': 'volume-f9f930ff-9209-465e-bd18-a01385f91ad2', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5510c0b-128a-4750-aaab-76fa706c7b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5510c0b-128a-4750-aaab-76fa706c7b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab743c6-400a-4ce3-a722-0ebc918b9408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:09 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Volume f9f930ff-9209-465e-bd18-a01385f91ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f930ff-9209-465e-bd18-a01385f91ad2', 'volume_size': 1} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-80408809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f930ff-9209-465e-bd18-a01385f91ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:09Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Creating volume f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:09 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:09 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 1073741824 Apr 09 17:37:09 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:09 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 1073741824" returned: 0 in 0.578s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:09 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:09 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:10 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.459s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab743c6-400a-4ce3-a722-0ebc918b9408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f930ff-9209-465e-bd18-a01385f91ad2', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e20e8a2-3614-40c4-893b-cd918e27fff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Volume volume-f9f930ff-9209-465e-bd18-a01385f91ad2 (f9f930ff-9209-465e-bd18-a01385f91ad2): created successfully Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e20e8a2-3614-40c4-893b-cd918e27fff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (39cfbb30-4431-4f24-8bb4-904dea48fe6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-274298e8-8287-4da2-8ded-66e11898daa7 tempest-VolumesSnapshotTestJSON-258885215 None] Created volume successfully. Apr 09 17:37:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Creating offline snapshot 6f5c7bd5-7b41-4ae3-bb28-28583f615c2d of volume f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:37:11 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[861da793-24ca-46e5-a5a5-0541e69bde1c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:11 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:11 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:12 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.677s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:12 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d 1G Apr 09 17:37:12 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:12 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d 1G" returned: 0 in 0.737s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f930ff-9209-465e-bd18-a01385f91ad2 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:12 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f930ff-9209-465e-bd18-a01385f91ad2 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d Apr 09 17:37:12 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Flow 'volume_create_manager' (241ec9e2-4527-4e34-83f5-32800ccaac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f49b8c-eee8-45c5-aa26-0062170fe6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f49b8c-eee8-45c5-aa26-0062170fe6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1868518227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0450fcc-d98a-468e-b231-1df2dda8a6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c952c92b98814af3950847cbdd04b254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:13Z,use_quota=True,user_id='bad76434a3f14ca48f9007bd0a5de5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03402d2d-021e-487d-a80c-62d41071c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03402d2d-021e-487d-a80c-62d41071c84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08322e42-0747-41e3-a47f-a4986e8d5473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08322e42-0747-41e3-a47f-a4986e8d5473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0450fcc-d98a-468e-b231-1df2dda8a6e5', 'volume_name': 'volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f51db7-615c-48f8-83be-fae35c7325ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f51db7-615c-48f8-83be-fae35c7325ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e705cb76-612a-4bb5-aad2-3b1b4b7a60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Volume e0450fcc-d98a-468e-b231-1df2dda8a6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5', 'volume_size': 1} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:13 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f930ff-9209-465e-bd18-a01385f91ad2 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" returned: 0 in 0.606s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:13 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d is being set with open permissions: ugo+rw Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:13 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d Apr 09 17:37:13 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (4a999a5c-15c1-4066-8d90-ca444ca2920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c781f064-8d15-4917-9ee8-f3382ce53e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c781f064-8d15-4917-9ee8-f3382ce53e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929878670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da81ac5-2bad-49b3-83f0-2e433a2c7125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:13Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19033cce-d06d-4c72-bfe8-680f7a98dcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19033cce-d06d-4c72-bfe8-680f7a98dcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3115e480-bc15-4b64-8d22-001e2563465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3115e480-bc15-4b64-8d22-001e2563465b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da81ac5-2bad-49b3-83f0-2e433a2c7125', 'volume_name': 'volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d20efaf-5260-4caa-bd84-d335241dc5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d20efaf-5260-4caa-bd84-d335241dc5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0460af0b-890d-418c-bab4-2a85d50c7c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:13 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Volume 7da81ac5-2bad-49b3-83f0-2e433a2c7125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125', 'volume_size': 1} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:13 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:13 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info Apr 09 17:37:13 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:14 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info" returned: 0 in 0.603s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:14 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info is being set with open permissions: ugo+rw Apr 09 17:37:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:14 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info Apr 09 17:37:14 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:15 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.info" returned: 0 in 0.452s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.730s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1868518227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0450fcc-d98a-468e-b231-1df2dda8a6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c952c92b98814af3950847cbdd04b254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:13Z,use_quota=True,user_id='bad76434a3f14ca48f9007bd0a5de5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Creating volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:15 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:15 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-533c9b0b-6900-4fce-b7f9-18123e410f7c tempest-VolumesSnapshotTestJSON-258885215 None] Create snapshot completed successfully Apr 09 17:37:15 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 1073741824 Apr 09 17:37:15 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:15 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 1073741824" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:15 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 Apr 09 17:37:15 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (b39dde78-c9b1-42b7-bcbf-bddaa54bd2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1cb431-6052-4d53-9f3f-ed11799d10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1cb431-6052-4d53-9f3f-ed11799d10b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-509220864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e883b12-eba6-4ea7-8da0-8fa49709e22d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdebf02b0fe242448b770bc5f47a6174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f5c7bd5-7b41-4ae3-bb28-28583f615c2d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:16Z,use_quota=True,user_id='5dbafb0473ae4736bdde206bfddb7283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf41d7f9-53bf-48b0-b408-74fcf16c4278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf41d7f9-53bf-48b0-b408-74fcf16c4278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2ab0ac-dcc0-458d-ae30-c9a6897e0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2ab0ac-dcc0-458d-ae30-c9a6897e0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e883b12-eba6-4ea7-8da0-8fa49709e22d', 'volume_name': 'volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d', 'volume_size': 1, 'snapshot_id': '6f5c7bd5-7b41-4ae3-bb28-28583f615c2d'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe59c9ab-e205-42e3-9f5b-ab16de532f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe59c9ab-e205-42e3-9f5b-ab16de532f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18608230-f8fb-4b7c-a0ed-27298c1d2585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:16 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Volume 9e883b12-eba6-4ea7-8da0-8fa49709e22d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d', 'volume_size': 1, 'snapshot_id': '6f5c7bd5-7b41-4ae3-bb28-28583f615c2d'} Apr 09 17:37:16 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5" returned: 0 in 0.611s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.670s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929878670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da81ac5-2bad-49b3-83f0-2e433a2c7125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:13Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Creating volume 7da81ac5-2bad-49b3-83f0-2e433a2c7125 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:16 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e705cb76-612a-4bb5-aad2-3b1b4b7a60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959f65b9-a9b9-42e0-b549-0750cdc96ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:16 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Volume volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 (e0450fcc-d98a-468e-b231-1df2dda8a6e5): created successfully Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959f65b9-a9b9-42e0-b549-0750cdc96ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Flow 'volume_create_manager' (241ec9e2-4527-4e34-83f5-32800ccaac33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:16 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 1073741824 Apr 09 17:37:16 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:16 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9014f402-a9a2-400b-a619-014b81249cc4 tempest-VolumesSnapshotListTestJSON-57769890 None] Created volume successfully. Apr 09 17:37:16 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 1073741824" returned: 0 in 0.660s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:16 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 Apr 09 17:37:16 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:17 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125" returned: 0 in 0.462s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.164s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d-9e883b12-eba6-4ea7-8da0-8fa49709e22d" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0460af0b-890d-418c-bab4-2a85d50c7c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cfbf2d-2593-45c5-af36-276e78eb559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:17 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Volume volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 (7da81ac5-2bad-49b3-83f0-2e433a2c7125): created successfully Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cfbf2d-2593-45c5-af36-276e78eb559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (4a999a5c-15c1-4066-8d90-ca444ca2920b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d-9e883b12-eba6-4ea7-8da0-8fa49709e22d" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Creating volume 9e883b12-eba6-4ea7-8da0-8fa49709e22d from snapshot 6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-9e883b12-eba6-4ea7-8da0-8fa49709e22d" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d5dacadd-00d6-4caf-aecd-897422951bc3 tempest-VolumesActionsTest-1117277206 None] Created volume successfully. Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-9e883b12-eba6-4ea7-8da0-8fa49709e22d" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] snapshot: 6f5c7bd5-7b41-4ae3-bb28-28583f615c2d, volume: 9e883b12-eba6-4ea7-8da0-8fa49709e22d, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4551968-3f52-4fce-8b35-da4233e37284]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:17 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d Apr 09 17:37:17 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b0674ee6-14a3-4ec0-acdd-39c69a626748 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125" by "attach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b0674ee6-14a3-4ec0-acdd-39c69a626748 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125" acquired by "attach_volume" :: waited 0.022s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b0674ee6-14a3-4ec0-acdd-39c69a626748 tempest-VolumesActionsTest-1117277206 None] Attaching volume 7da81ac5-2bad-49b3-83f0-2e433a2c7125 to instance 858970e9-4353-45c9-90b6-77ebfdc8d5cb at mountpoint /dev/vdb on host None. Apr 09 17:37:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b0674ee6-14a3-4ec0-acdd-39c69a626748 tempest-VolumesActionsTest-1117277206 None] Attach volume completed successfully. Apr 09 17:37:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b0674ee6-14a3-4ec0-acdd-39c69a626748 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125" released by "attach_volume" :: held 0.118s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:18 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" returned: 0 in 0.697s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f930ff-9209-465e-bd18-a01385f91ad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f8703b-0588-43bc-992b-534107043acc]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:18 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:18 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b4efef17-8d06-4e94-a1e5-79d7799ee422 tempest-VolumesActionsTest-753674556 None] Terminate volume connection completed successfully. Apr 09 17:37:18 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.522s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:37:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:18 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d Apr 09 17:37:18 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b4efef17-8d06-4e94-a1e5-79d7799ee422 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-detach_volume" by "detach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b4efef17-8d06-4e94-a1e5-79d7799ee422 tempest-VolumesActionsTest-753674556 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b4efef17-8d06-4e94-a1e5-79d7799ee422 tempest-VolumesActionsTest-753674556 None] Detaching volume 7da81ac5-2bad-49b3-83f0-2e433a2c7125 from instance 858970e9-4353-45c9-90b6-77ebfdc8d5cb. Apr 09 17:37:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b4efef17-8d06-4e94-a1e5-79d7799ee422 tempest-VolumesActionsTest-753674556 None] Detach volume completed successfully. Apr 09 17:37:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b4efef17-8d06-4e94-a1e5-79d7799ee422 tempest-VolumesActionsTest-753674556 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6262e4e-e660-4b68-8dfe-5655ed6ced78 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-detach_volume" by "detach_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6262e4e-e660-4b68-8dfe-5655ed6ced78 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:19 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a6262e4e-e660-4b68-8dfe-5655ed6ced78 tempest-VolumesActionsTest-1117277206 None] Volume detach called, but volume not attached. Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6262e4e-e660-4b68-8dfe-5655ed6ced78 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Acquiring lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Acquiring lock "cinder-quobyte-7da81ac5-2bad-49b3-83f0-2e433a2c7125" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Lock "cinder-quobyte-7da81ac5-2bad-49b3-83f0-2e433a2c7125" acquired by "delete_volume" :: waited 0.067s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cae625-f37e-44a2-b73b-8c0520b0e01f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:21 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 Apr 09 17:37:21 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:21 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d" returned: 0 in 2.710s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:21 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1dd338-0869-4d79-80ad-3ef3a82c8151]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:21 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:21 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:21 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125" returned: 0 in 0.882s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:21 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125 Apr 09 17:37:21 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:22 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.665s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2, size 1024.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:37:22 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Converted 1024.00 MB image at 377.68 MB/s Apr 09 17:37:22 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d is being set with open permissions: ugo+rw Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:22 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d Apr 09 17:37:22 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:22 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7da81ac5-2bad-49b3-83f0-2e433a2c7125" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Lock "cinder-quobyte-7da81ac5-2bad-49b3-83f0-2e433a2c7125" released by "delete_volume" :: held 1.359s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Created reservations ['2596ebc6-10d6-4eb6-ad4c-29bef98def51', 'd2d49cb3-a992-4db2-9720-7501f8cbdeeb', 'bda11ca3-6008-44db-a8b7-a7cc97bec22e', '46b16601-2eb7-4ba3-be11-fc91a2ea115d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:22 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:22 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:22 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d" returned: 0 in 0.419s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-9e883b12-eba6-4ea7-8da0-8fa49709e22d" released by "_copy_volume_from_snapshot" :: held 5.098s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d-9e883b12-eba6-4ea7-8da0-8fa49709e22d" released by "_create_volume_from_snapshot" :: held 5.131s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.200s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.062s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Creating offline snapshot 1a71f036-5b02-4a83-9755-bb34b9fb3998 of volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796d8da-eb4a-49ad-9cc2-b16dcfba30c6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18608230-f8fb-4b7c-a0ed-27298c1d2585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d', 'volume_size': 1, 'snapshot_id': '6f5c7bd5-7b41-4ae3-bb28-28583f615c2d'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b294d042-4066-4c19-b3f1-1aceade81912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:22 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Volume volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d (9e883b12-eba6-4ea7-8da0-8fa49709e22d): created successfully Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b294d042-4066-4c19-b3f1-1aceade81912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Flow 'volume_create_manager' (b39dde78-c9b1-42b7-bcbf-bddaa54bd2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:22 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7224b19d-bf12-4bdf-8ede-e8c10379daf6 tempest-VolumesSnapshotTestJSON-258885215 None] Created volume successfully. Apr 09 17:37:22 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 Apr 09 17:37:22 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:22 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.467s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:22 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Deleted volume successfully. Apr 09 17:37:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8014e59-f4d2-4ff1-aecc-d3239967226d tempest-VolumesActionsTest-1117277206 None] Lock "cinder-7da81ac5-2bad-49b3-83f0-2e433a2c7125-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:23 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5" returned: 0 in 0.537s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:23 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 1G Apr 09 17:37:23 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-9e883b12-eba6-4ea7-8da0-8fa49709e22d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-9e883b12-eba6-4ea7-8da0-8fa49709e22d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-9e883b12-eba6-4ea7-8da0-8fa49709e22d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-9e883b12-eba6-4ea7-8da0-8fa49709e22d" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe185f7-a74b-4b3e-a2c3-e5e38df4a48d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:23 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 1G" returned: 0 in 0.542s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:23 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:23 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:23 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d Apr 09 17:37:23 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:24 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.520s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:24 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 is being set with open permissions: ugo+rw Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:24 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:24 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:24 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d" returned: 0 in 0.684s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:24 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d Apr 09 17:37:24 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:24 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.486s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:24 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info Apr 09 17:37:24 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:24 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9e883b12-eba6-4ea7-8da0-8fa49709e22d" returned: 0 in 0.553s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-9e883b12-eba6-4ea7-8da0-8fa49709e22d" released by "delete_volume" :: held 1.262s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['dafe6d68-8da4-40fe-90a1-bad767549f34', '34b7f0ba-d90d-416e-941b-55198f8a884e', '808a28ae-3e31-4cdc-abd0-33951fd05d52', 'b2857693-52a7-4149-b578-50e75223c9f2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:25 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:25 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:25 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info" returned: 0 in 0.451s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:25 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info is being set with open permissions: ugo+rw Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:25 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info Apr 09 17:37:25 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:25 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Deleted volume successfully. Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-77fcb391-e51c-465d-8fb6-23a71c2a0628 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-9e883b12-eba6-4ea7-8da0-8fa49709e22d-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:25 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.info" returned: 0 in 0.597s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.203s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6697d942-5d31-42c3-bcb7-ae2d01ada9cc tempest-VolumesSnapshotListTestJSON-57769890 None] Create snapshot completed successfully Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-f9f930ff-9209-465e-bd18-a01385f91ad2" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-f9f930ff-9209-465e-bd18-a01385f91ad2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Deleting offline snapshot 6f5c7bd5-7b41-4ae3-bb28-28583f615c2d of volume f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] snapshot_file for this snap is: volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[93799f83-d3ff-48e1-b2a6-ee54c10cf407]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:26 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d Apr 09 17:37:26 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:26 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" returned: 0 in 0.537s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f930ff-9209-465e-bd18-a01385f91ad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0183f3cb-60e0-4439-9ba5-179262a2c9a0]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:26 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:26 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Creating offline snapshot e400899d-da06-48fd-9d91-cb8a5ecb5575 of volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d072d7a-282f-4b4d-bb4c-b418a4115b54]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:27 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.555s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:27 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d Apr 09 17:37:27 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:27 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:27 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:27 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.498s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:27 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 1G Apr 09 17:37:27 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:27 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" returned: 0 in 0.479s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:27 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d Apr 09 17:37:27 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:28 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2.6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" returned: 0 in 0.524s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d" released by "_delete_snapshot" :: held 2.150s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-f9f930ff-9209-465e-bd18-a01385f91ad2" released by "delete_snapshot" :: held 2.165s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['d8b99730-5fcc-465a-a8d2-b1ef086d546a', '6f1ac3fa-6bf2-424e-b4c1-3c36e394845f', '00cf5e3e-f6aa-4f92-a69a-efc80806fa75', 'd6798ba3-8395-487f-8a90-e7e6c09dca8d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:28 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 1G" returned: 0 in 0.654s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:28 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Delete snapshot completed successfully. Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6b32d1fc-2cfe-4646-9795-47040408bceb tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-6f5c7bd5-7b41-4ae3-bb28-28583f615c2d-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:28 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:28 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Acquiring lock "cinder-91de8b83-7650-46d7-8ac4-b5504198f7b3-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Lock "cinder-91de8b83-7650-46d7-8ac4-b5504198f7b3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Acquiring lock "cinder-quobyte-91de8b83-7650-46d7-8ac4-b5504198f7b3" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Lock "cinder-quobyte-91de8b83-7650-46d7-8ac4-b5504198f7b3" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd88014-1d2d-4119-b8ff-c4e033fdd170]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:28 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 Apr 09 17:37:28 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:28 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.486s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:28 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 is being set with open permissions: ugo+rw Apr 09 17:37:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:28 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:28 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:29 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3" returned: 0 in 0.487s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:29 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3 Apr 09 17:37:29 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:29 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:29 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-fcc58074-4520-441c-939c-00f8e40e7754 tempest-VolumesSnapshotListTestJSON-57769890 None] Create snapshot completed successfully Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-f9f930ff-9209-465e-bd18-a01385f91ad2-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-f9f930ff-9209-465e-bd18-a01385f91ad2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-f9f930ff-9209-465e-bd18-a01385f91ad2" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-f9f930ff-9209-465e-bd18-a01385f91ad2" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4457353-87f4-435d-b15d-a0c419bf524f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:29 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:29 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (40e9fb07-4d57-48aa-99dc-4759f16112d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373ad863-e767-4f6b-aaf6-f6605f88cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373ad863-e767-4f6b-aaf6-f6605f88cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-836957162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9539850a-4505-4b62-9e0f-a3509393cc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:29Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d97028-edc6-448c-aced-43a96cf51255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d97028-edc6-448c-aced-43a96cf51255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d4cbd2-668b-4dd1-a690-2846f39e3e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d4cbd2-668b-4dd1-a690-2846f39e3e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9539850a-4505-4b62-9e0f-a3509393cc95', 'volume_name': 'volume-9539850a-4505-4b62-9e0f-a3509393cc95', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76e82d6-23b0-4531-bfb5-774d307b387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76e82d6-23b0-4531-bfb5-774d307b387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690b55e0-fbb5-4b3c-8498-e8399b16cf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Volume 9539850a-4505-4b62-9e0f-a3509393cc95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9539850a-4505-4b62-9e0f-a3509393cc95', 'volume_size': 1} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-836957162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9539850a-4505-4b62-9e0f-a3509393cc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:29Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Creating volume 9539850a-4505-4b62-9e0f-a3509393cc95 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:29 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:29 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 1073741824 Apr 09 17:37:29 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:29 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-91de8b83-7650-46d7-8ac4-b5504198f7b3" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Lock "cinder-quobyte-91de8b83-7650-46d7-8ac4-b5504198f7b3" released by "delete_volume" :: held 0.994s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Created reservations ['313701f3-60b1-400e-a811-164f6096c8a5', '0faae1cb-2616-4fcf-8e66-24fa8c21cb15', 'ed47b2b2-651e-4e1c-a400-9e6942f9c101', '4db67917-c81e-4899-9b66-c53cf44ac279'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:29 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:29 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:29 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.517s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:29 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2 Apr 09 17:37:29 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:29 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 1073741824" returned: 0 in 0.491s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:29 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 Apr 09 17:37:29 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:30 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Deleted volume successfully. Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-47472c89-68b9-4761-aa55-a0941f55e8d1 tempest-VolumesNegativeTest-1357997287 None] Lock "cinder-91de8b83-7650-46d7-8ac4-b5504198f7b3-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:30 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-f9f930ff-9209-465e-bd18-a01385f91ad2" returned: 0 in 0.476s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-f9f930ff-9209-465e-bd18-a01385f91ad2" released by "delete_volume" :: held 1.022s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['fc597059-af19-42fd-94fb-6dcda9c38e80', '3a504daa-e34e-4d05-8dd7-91a8ff321950', 'a838d357-1258-46c2-9568-1382c2cb4024', 'a17d3b7e-7655-4980-b9ee-d1769bc6bb03'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:30 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:30 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:30 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.124s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Creating offline snapshot 70b1c960-4d8f-4035-8614-3ccae1bb8705 of volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690b55e0-fbb5-4b3c-8498-e8399b16cf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9539850a-4505-4b62-9e0f-a3509393cc95', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdad354-9334-4d2e-b3fd-71b8d81037f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e55e10-e13c-476a-a69c-8a8d814c8c24]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:30 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Volume volume-9539850a-4505-4b62-9e0f-a3509393cc95 (9539850a-4505-4b62-9e0f-a3509393cc95): created successfully Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdad354-9334-4d2e-b3fd-71b8d81037f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (40e9fb07-4d57-48aa-99dc-4759f16112d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9a23c29c-17e0-426d-9d46-8c81382cb96b tempest-VolumesActionsTest-1117277206 None] Created volume successfully. Apr 09 17:37:30 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:30 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:30 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Deleted volume successfully. Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-775dbdff-78ab-45bd-a7d5-5fc2ff40e9b2 tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-f9f930ff-9209-465e-bd18-a01385f91ad2-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:30 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:30 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 1G Apr 09 17:37:30 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "cinder-quobyte-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f36c3-a027-4687-af9e-212c0279394d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:31 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 1G" returned: 0 in 0.593s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:31 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 Apr 09 17:37:31 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:31 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb Apr 09 17:37:31 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-9539850a-4505-4b62-9e0f-a3509393cc95-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Lock "cinder-9539850a-4505-4b62-9e0f-a3509393cc95-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-quobyte-9539850a-4505-4b62-9e0f-a3509393cc95" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-9539850a-4505-4b62-9e0f-a3509393cc95" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc4a9a-1c33-4865-8110-466effced6af]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:31 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 Apr 09 17:37:31 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:31 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705" returned: 0 in 0.512s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:31 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 is being set with open permissions: ugo+rw Apr 09 17:37:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:32 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 Apr 09 17:37:32 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:32 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" returned: 0 in 0.576s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:32 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb Apr 09 17:37:32 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (b39fdea3-d650-415a-8662-d330a4f50b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:32 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1faa89-110f-4485-8afa-51d865755392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1faa89-110f-4485-8afa-51d865755392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-229098610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:32Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0a6b2b-3bf3-40a1-82c7-c2730aa5ae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0a6b2b-3bf3-40a1-82c7-c2730aa5ae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e317a48-06cb-4144-afe5-612952ef3872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e317a48-06cb-4144-afe5-612952ef3872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe', 'volume_name': 'volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c656a-b0ab-41bf-8a17-eb11d25a9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c656a-b0ab-41bf-8a17-eb11d25a9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7c8a7f-ddd3-4df1-9f19-aa5e01cc2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:32 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe', 'volume_size': 1} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95" returned: 0 in 0.584s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:32 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95 Apr 09 17:37:32 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:32 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705" returned: 0 in 0.427s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.211s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-229098610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:32Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Creating volume dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:32 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:32 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:32 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d94dd929-338f-4055-9255-cab0b817914d tempest-VolumesSnapshotListTestJSON-57769890 None] Create snapshot completed successfully Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:32 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe 1073741824 Apr 09 17:37:32 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-quobyte-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb" released by "delete_volume" :: held 1.101s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Created reservations ['c6617758-bbaf-4e60-8a07-f8a5c5095b75', 'a413c195-1690-46eb-a64f-93d721b843a5', '2234a6d4-4fe0-4e6e-bed7-cf1756881f0e', '6b805a18-e840-469b-b8d7-51eaae6c94b0'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:32 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:32 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:32 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9539850a-4505-4b62-9e0f-a3509393cc95" returned: 0 in 0.423s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-9539850a-4505-4b62-9e0f-a3509393cc95" released by "delete_volume" :: held 1.029s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Created reservations ['8917bc6a-b3e2-4b17-92a4-0c9502459c64', '2b549afc-3a06-4a10-8f8e-fdc7862a2f26', 'bd26fbd9-a30f-4b8f-84c0-daed285c9b4a', '514add96-17a7-41a0-ac82-48d10b839fa2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:32 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:32 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:32 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe 1073741824" returned: 0 in 0.516s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:33 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.420s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Deleted volume successfully. Apr 09 17:37:33 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe Apr 09 17:37:33 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b97450b2-e348-4e73-a543-59fc7548d7fa tempest-VolumesSnapshotTestJSON-258885215 None] Lock "cinder-8ef44c9e-d114-4c38-a10f-e4e15dfcebfb-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:33 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Deleted volume successfully. Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-71ca3e13-3a8f-4f5f-9213-d1d71b303786 tempest-VolumesActionsTest-753674556 None] Lock "cinder-9539850a-4505-4b62-9e0f-a3509393cc95-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:33 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7c8a7f-ddd3-4df1-9f19-aa5e01cc2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691e6d61-c85c-4ca9-bfe5-c9e2d76195cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:33 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe (dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe): created successfully Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691e6d61-c85c-4ca9-bfe5-c9e2d76195cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (b39fdea3-d650-415a-8662-d330a4f50b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e328bfa9-bd5b-4a41-99f1-e052e15ee3f1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created volume successfully. Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-70b1c960-4d8f-4035-8614-3ccae1bb8705-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-70b1c960-4d8f-4035-8614-3ccae1bb8705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-70b1c960-4d8f-4035-8614-3ccae1bb8705" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-70b1c960-4d8f-4035-8614-3ccae1bb8705" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Deleting offline snapshot 70b1c960-4d8f-4035-8614-3ccae1bb8705 of volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] snapshot_file for this snap is: volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dc6848-d732-4bd8-a1c1-860ff331c846]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:34 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 Apr 09 17:37:34 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (c49a9972-0de1-4cbf-bb2e-b266e20c3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ef1f28-ae88-46d5-809e-26f0992e8b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ef1f28-ae88-46d5-809e-26f0992e8b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352062890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0888a66-8df9-42a8-bdd7-01d63d4fae32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:34Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576d37a9-346b-4a68-9c3b-ce390c1e42a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576d37a9-346b-4a68-9c3b-ce390c1e42a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c707d941-71cf-4331-bd2e-f6d920d6e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c707d941-71cf-4331-bd2e-f6d920d6e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0888a66-8df9-42a8-bdd7-01d63d4fae32', 'volume_name': 'volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25241359-045f-45bf-a964-f13e1476b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25241359-045f-45bf-a964-f13e1476b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f808c404-820d-4283-a80e-aa43301b2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Volume a0888a66-8df9-42a8-bdd7-01d63d4fae32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32', 'volume_size': 1} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1352062890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0888a66-8df9-42a8-bdd7-01d63d4fae32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:34Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Creating volume a0888a66-8df9-42a8-bdd7-01d63d4fae32 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:34 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:34 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 1073741824 Apr 09 17:37:34 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:34 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705" returned: 0 in 0.574s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[01832b01-3e47-4c3e-ac63-ed5a992b3b43]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:34 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:34 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (40858d3a-378d-44e2-adb5-33a685ffe220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9e81d1-94ed-4a06-8dfb-84afef019f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9e81d1-94ed-4a06-8dfb-84afef019f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691610432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470b6567-8212-4d20-a4fc-0375c68b7e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3464f934-1f6e-49d1-ad6f-9f0f2c8e745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3464f934-1f6e-49d1-ad6f-9f0f2c8e745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fd505b-f7a4-4118-bf1a-399fd27fecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06fd505b-f7a4-4118-bf1a-399fd27fecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470b6567-8212-4d20-a4fc-0375c68b7e5c', 'volume_name': 'volume-470b6567-8212-4d20-a4fc-0375c68b7e5c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc98d6cb-f5af-4796-8ece-fa4aa8ed92ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc98d6cb-f5af-4796-8ece-fa4aa8ed92ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c56a51-8dff-436b-8e94-4697d6c0c367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume 470b6567-8212-4d20-a4fc-0375c68b7e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470b6567-8212-4d20-a4fc-0375c68b7e5c', 'volume_size': 1} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (42ed264d-3d70-4a79-9056-98875b68bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c4d01f-9230-42ef-834f-eaf7fb88dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c4d01f-9230-42ef-834f-eaf7fb88dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1584897871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27011559-07bb-4096-bb9a-c253babf1771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee1c79f-bde0-46c4-987b-73524e916f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee1c79f-bde0-46c4-987b-73524e916f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a0221c-18f2-45e2-bb6c-2d0949968a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a0221c-18f2-45e2-bb6c-2d0949968a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27011559-07bb-4096-bb9a-c253babf1771', 'volume_name': 'volume-27011559-07bb-4096-bb9a-c253babf1771', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39626dd6-1831-4dab-8828-4057c2f437f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39626dd6-1831-4dab-8828-4057c2f437f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3253ab-7810-4f2d-ad4a-1cbcd5ea68a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:34 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume 27011559-07bb-4096-bb9a-c253babf1771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27011559-07bb-4096-bb9a-c253babf1771', 'volume_size': 1} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 1073741824" returned: 0 in 0.708s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:34 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 Apr 09 17:37:34 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (edc4bed4-9d83-4100-b01b-24b120d1dcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5657b6aa-6831-441e-b6ec-812ec7254582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5657b6aa-6831-441e-b6ec-812ec7254582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-569101360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08525d6b-6301-4441-86aa-3539d988c16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08525d6b-6301-4441-86aa-3539d988c16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688449ec-a028-4878-877e-dbfca71995b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688449ec-a028-4878-877e-dbfca71995b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe', 'volume_name': 'volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0bf9a9-0774-4128-a7d1-854bffcaadaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0bf9a9-0774-4128-a7d1-854bffcaadaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec550f53-55e3-4413-a110-bf40a88f286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume 239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe', 'volume_size': 1} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.700s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:35 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 Apr 09 17:37:35 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (e1fb1b23-1fa3-4196-934d-e496727d8292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8d5441-87a1-408f-bdb7-fd4668e8fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8d5441-87a1-408f-bdb7-fd4668e8fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-189067286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f073c70-235f-42a6-a376-8b6e842cc21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd032c6-7863-490e-a462-8ccc221bf16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd032c6-7863-490e-a462-8ccc221bf16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a443d92-57b0-42cd-b542-1a4ee2879dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a443d92-57b0-42cd-b542-1a4ee2879dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f073c70-235f-42a6-a376-8b6e842cc21b', 'volume_name': 'volume-3f073c70-235f-42a6-a376-8b6e842cc21b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bfc7b7-788d-464a-a001-3c9a6a214eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bfc7b7-788d-464a-a001-3c9a6a214eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44aaf26-e395-40df-9219-14f0e479a66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume 3f073c70-235f-42a6-a376-8b6e842cc21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f073c70-235f-42a6-a376-8b6e842cc21b', 'volume_size': 1} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32" returned: 0 in 0.630s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691610432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470b6567-8212-4d20-a4fc-0375c68b7e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Creating volume 470b6567-8212-4d20-a4fc-0375c68b7e5c {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:35 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f808c404-820d-4283-a80e-aa43301b2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e444c6d-edc1-4eac-833b-3dc03b831fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c 1073741824 Apr 09 17:37:35 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:35 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Volume volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 (a0888a66-8df9-42a8-bdd7-01d63d4fae32): created successfully Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e444c6d-edc1-4eac-833b-3dc03b831fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (c49a9972-0de1-4cbf-bb2e-b266e20c3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (88c67c47-2ad8-4cfd-bfbb-4f59a6a5889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c549a1-bb4c-496a-9a8d-11484bdd0d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c549a1-bb4c-496a-9a8d-11484bdd0d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307053102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da28645-5f8a-4270-8d76-ebe233c877c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:36Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d19f2e6-49ec-4cec-9c4f-e5e9d52737ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d19f2e6-49ec-4cec-9c4f-e5e9d52737ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfc99b-ddc9-495e-bc10-3095b602e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfc99b-ddc9-495e-bc10-3095b602e51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da28645-5f8a-4270-8d76-ebe233c877c9', 'volume_name': 'volume-4da28645-5f8a-4270-8d76-ebe233c877c9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd7ef2f-d46b-40c4-8f73-d287e0b1b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd7ef2f-d46b-40c4-8f73-d287e0b1b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23fd40e-2209-4829-a8fd-750567cded71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:35 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume 4da28645-5f8a-4270-8d76-ebe233c877c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da28645-5f8a-4270-8d76-ebe233c877c9', 'volume_size': 1} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7caf1acf-3f08-4469-b007-6a7c55ef00d3 tempest-VolumesActionsTest-1117277206 None] Created volume successfully. Apr 09 17:37:35 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705" returned: 0 in 0.663s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:35 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705 Apr 09 17:37:35 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:36 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c 1073741824" returned: 0 in 0.570s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:36 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c Apr 09 17:37:36 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-a0888a66-8df9-42a8-bdd7-01d63d4fae32-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:36 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.70b1c960-4d8f-4035-8614-3ccae1bb8705" returned: 0 in 0.556s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Lock "cinder-a0888a66-8df9-42a8-bdd7-01d63d4fae32-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-70b1c960-4d8f-4035-8614-3ccae1bb8705" released by "_delete_snapshot" :: held 2.556s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" released by "delete_snapshot" :: held 2.581s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-quobyte-a0888a66-8df9-42a8-bdd7-01d63d4fae32" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-a0888a66-8df9-42a8-bdd7-01d63d4fae32" acquired by "delete_volume" :: waited 0.034s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Created reservations ['6de87614-b8fd-4ecb-b6bf-bf9ab18a590b', '138a6456-e8dd-4082-9943-4153be8bea67', '93e84eb7-0538-4ba4-8536-68cc38c9828e', '9663c9ab-49c4-4756-9d15-b488cb946b1f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73b5be3-cc72-4031-ad5a-370067abc42c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Delete snapshot completed successfully. Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-cdfb95d1-c85d-4a01-a860-0008c4cbe87f tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-70b1c960-4d8f-4035-8614-3ccae1bb8705-delete_snapshot" released by "delete_snapshot" :: held 2.712s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:36 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:36 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 Apr 09 17:37:36 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c" returned: 0 in 0.527s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1584897871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27011559-07bb-4096-bb9a-c253babf1771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Creating volume 27011559-07bb-4096-bb9a-c253babf1771 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:36 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c56a51-8dff-436b-8e94-4697d6c0c367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470b6567-8212-4d20-a4fc-0375c68b7e5c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38edb5e2-d3cd-4572-b830-8d93709020fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:36 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 1073741824 Apr 09 17:37:36 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:36 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume volume-470b6567-8212-4d20-a4fc-0375c68b7e5c (470b6567-8212-4d20-a4fc-0375c68b7e5c): created successfully Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38edb5e2-d3cd-4572-b830-8d93709020fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (40858d3a-378d-44e2-adb5-33a685ffe220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-895e13a9-f03e-4237-a9f2-77dd412b1290 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created volume successfully. Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-e400899d-da06-48fd-9d91-cb8a5ecb5575-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-e400899d-da06-48fd-9d91-cb8a5ecb5575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:37 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32" returned: 0 in 0.517s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-e400899d-da06-48fd-9d91-cb8a5ecb5575" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:37 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32 Apr 09 17:37:37 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e400899d-da06-48fd-9d91-cb8a5ecb5575" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Deleting offline snapshot e400899d-da06-48fd-9d91-cb8a5ecb5575 of volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] snapshot_file for this snap is: volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad05c65-923c-408e-b84f-e2f1bd37026b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:37 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:37 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:37 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 1073741824" returned: 0 in 0.646s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:37 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 Apr 09 17:37:37 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:37 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0888a66-8df9-42a8-bdd7-01d63d4fae32" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-a0888a66-8df9-42a8-bdd7-01d63d4fae32" released by "delete_volume" :: held 1.032s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Created reservations ['55ff6749-d4bf-446a-acce-b6d5bdcabcda', '5cc779e4-b4ad-4cf7-9552-c52fbf05600c', '5fa1f60a-45de-4024-9bbd-a72a9e092a1b', '52f9da34-a9b0-4ba8-ae38-bde0feb8af7f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:37 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:37 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:37 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.559s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ee26b-43ac-4344-83ac-f5841a2b7b3f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:37 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:37 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:37 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771" returned: 0 in 0.530s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.638s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-569101360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Creating volume 239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:37 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3253ab-7810-4f2d-ad4a-1cbcd5ea68a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27011559-07bb-4096-bb9a-c253babf1771', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a014a94e-0661-4ec8-aadd-9ebd1dd7fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:37 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe 1073741824 Apr 09 17:37:37 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:37 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume volume-27011559-07bb-4096-bb9a-c253babf1771 (27011559-07bb-4096-bb9a-c253babf1771): created successfully Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a014a94e-0661-4ec8-aadd-9ebd1dd7fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (42ed264d-3d70-4a79-9056-98875b68bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (eb466443-5046-45ad-a8e2-18cf99e4f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24545641-626c-4856-a6de-d2507683f71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:37 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c0fc03cd-c4cf-438b-89a3-209ec2814b9d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created volume successfully. Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24545641-626c-4856-a6de-d2507683f71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-56214222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4483a5a0-75dc-4b0e-97bf-93a93909761d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:38Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf425d9f-9fcc-4dbb-9bb6-238acfa9f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf425d9f-9fcc-4dbb-9bb6-238acfa9f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f3ea61-e5ee-4926-ac36-6231967cf7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f3ea61-e5ee-4926-ac36-6231967cf7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4483a5a0-75dc-4b0e-97bf-93a93909761d', 'volume_name': 'volume-4483a5a0-75dc-4b0e-97bf-93a93909761d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f466fb-7bff-4cfe-af2a-b5d362d37bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f466fb-7bff-4cfe-af2a-b5d362d37bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8e7e15-ebad-43dc-9c38-4c74f8c0d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Volume 4483a5a0-75dc-4b0e-97bf-93a93909761d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4483a5a0-75dc-4b0e-97bf-93a93909761d', 'volume_size': 1} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:38 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.498s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Deleted volume successfully. Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aaed764b-c1c0-47ed-aea5-ef1354b252fa tempest-VolumesActionsTest-753674556 None] Lock "cinder-a0888a66-8df9-42a8-bdd7-01d63d4fae32-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (0749a6cb-5e49-4e4b-ad2e-39f27c5745b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ca23e9-0913-47cd-9c0c-0d751a63f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ca23e9-0913-47cd-9c0c-0d751a63f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194450521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d02dbae-5a2f-43d1-92f1-da3c9da06c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:38Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc74bfd3-c635-4950-8d7d-65d890188464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc74bfd3-c635-4950-8d7d-65d890188464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7006c03-d303-4003-a66d-11a6248eaa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7006c03-d303-4003-a66d-11a6248eaa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d02dbae-5a2f-43d1-92f1-da3c9da06c5a', 'volume_name': 'volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab12068c-2acc-44eb-92ed-a4a90bfff25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab12068c-2acc-44eb-92ed-a4a90bfff25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5b41a3-0f69-459b-96f3-ea04c0d4e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Volume 4d02dbae-5a2f-43d1-92f1-da3c9da06c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a', 'volume_size': 1} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (6bd42259-d4ba-4599-9411-83d463d6270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e609370-9a47-48fc-8dcc-fb8409051f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e609370-9a47-48fc-8dcc-fb8409051f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1167032885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c2e959-6649-487f-b96f-02c2cfe84c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:38Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de753c1-5b92-4e39-8892-9fd07cf85ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de753c1-5b92-4e39-8892-9fd07cf85ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fc9c66-6cb6-44ef-8071-7f65edd422d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fc9c66-6cb6-44ef-8071-7f65edd422d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c2e959-6649-487f-b96f-02c2cfe84c05', 'volume_name': 'volume-67c2e959-6649-487f-b96f-02c2cfe84c05', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb907ad-17c5-4cb0-a1fa-b59ea5d9acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb907ad-17c5-4cb0-a1fa-b59ea5d9acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d464e7-5c62-4a62-bdf9-4b5a89b8ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Volume 67c2e959-6649-487f-b96f-02c2cfe84c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c2e959-6649-487f-b96f-02c2cfe84c05', 'volume_size': 1} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.725s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:38 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:38 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:38 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe 1073741824" returned: 0 in 0.662s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:38 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe Apr 09 17:37:38 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (ceff3cb1-3e09-4d98-934c-ceabe166f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa815ec-da37-40d0-bc53-bf206fff3870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa815ec-da37-40d0-bc53-bf206fff3870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308618997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8ca348-c118-40b4-aadf-b15d5644c296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:39Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f097f965-3db6-43ae-92b8-0bb3a25efd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f097f965-3db6-43ae-92b8-0bb3a25efd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbd14b5-ae6d-485f-9738-eaf9b0e1f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbd14b5-ae6d-485f-9738-eaf9b0e1f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8ca348-c118-40b4-aadf-b15d5644c296', 'volume_name': 'volume-7b8ca348-c118-40b4-aadf-b15d5644c296', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe9b674-50eb-400b-95ab-5bc2ab6027ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe9b674-50eb-400b-95ab-5bc2ab6027ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d24bf0-913c-463b-bc24-6de380338dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Volume 7b8ca348-c118-40b4-aadf-b15d5644c296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8ca348-c118-40b4-aadf-b15d5644c296', 'volume_size': 1} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (7accabfb-46ae-40cb-ba74-75ed664adcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813aaa8b-3a40-45ca-8906-f65107925a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813aaa8b-3a40-45ca-8906-f65107925a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-822178154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47c312-d51d-432b-891a-e1c86e4213a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:39Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d98c69-06e4-4ed6-8ce4-069402930daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d98c69-06e4-4ed6-8ce4-069402930daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d944dabb-bdf5-48c2-9d1b-e8e9bba5f04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d944dabb-bdf5-48c2-9d1b-e8e9bba5f04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f47c312-d51d-432b-891a-e1c86e4213a0', 'volume_name': 'volume-5f47c312-d51d-432b-891a-e1c86e4213a0', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e96da25-6dcb-403e-a580-cb2d61d8e484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e96da25-6dcb-403e-a580-cb2d61d8e484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df016b84-f45d-4188-bdaa-828c9a05cef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:38 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Volume 5f47c312-d51d-432b-891a-e1c86e4213a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f47c312-d51d-432b-891a-e1c86e4213a0', 'volume_size': 1} Apr 09 17:37:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (4e9639a2-912d-4edd-aac9-2f894eabf4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bdb47a-3be5-42f9-9622-7e83670ae74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bdb47a-3be5-42f9-9622-7e83670ae74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-565336546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07b0c60-26ab-414b-a55d-ed523b7c9fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:39Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fbc68e-cfc2-4aef-8afa-4bd38371322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fbc68e-cfc2-4aef-8afa-4bd38371322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42da90a6-271e-4010-9e69-cdd6d1d0a7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:39 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42da90a6-271e-4010-9e69-cdd6d1d0a7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07b0c60-26ab-414b-a55d-ed523b7c9fb7', 'volume_name': 'volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6553b96-1c3d-4efc-ba35-81b6369a8595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6553b96-1c3d-4efc-ba35-81b6369a8595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2aa938-104f-4c75-9f95-24f6ed1151cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:39 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Volume d07b0c60-26ab-414b-a55d-ed523b7c9fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7', 'volume_size': 1} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe" returned: 0 in 0.518s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.572s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-189067286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f073c70-235f-42a6-a376-8b6e842cc21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:35Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Creating volume 3f073c70-235f-42a6-a376-8b6e842cc21b {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:39 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec550f53-55e3-4413-a110-bf40a88f286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55d9802-3ac1-4dae-aac0-64060c30fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:39 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:39 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b 1073741824 Apr 09 17:37:39 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.671s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:39 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe (239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe): created successfully Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55d9802-3ac1-4dae-aac0-64060c30fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (edc4bed4-9d83-4100-b01b-24b120d1dcf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:39 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575 Apr 09 17:37:39 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e7ad7df6-1314-4bbf-93f3-8ad7ae1617e1 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created volume successfully. Apr 09 17:37:39 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.e400899d-da06-48fd-9d91-cb8a5ecb5575" returned: 0 in 0.433s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e400899d-da06-48fd-9d91-cb8a5ecb5575" released by "_delete_snapshot" :: held 2.464s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" released by "delete_snapshot" :: held 2.481s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:39 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b 1073741824" returned: 0 in 0.506s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Created reservations ['6d2f5aba-8e9a-4b79-b403-1f7a23c9bbf8', '313686aa-2775-4c93-930c-a6f2b1dce84f', 'ddf8a3a1-8a73-4281-9778-93453faea67b', '4ccb463c-ee54-4d77-bc1d-d2c9c969cf99'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:39 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b Apr 09 17:37:39 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Delete snapshot completed successfully. Apr 09 17:37:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c98ba81b-95c1-48fe-bae8-a47af56383ef tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-e400899d-da06-48fd-9d91-cb8a5ecb5575-delete_snapshot" released by "delete_snapshot" :: held 2.604s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:40 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.385s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307053102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da28645-5f8a-4270-8d76-ebe233c877c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3a80c036304b3bb6629078bd44f258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:36Z,use_quota=True,user_id='b4ac803d483344e9b9c77737e5e934ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Creating volume 4da28645-5f8a-4270-8d76-ebe233c877c9 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:40 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44aaf26-e395-40df-9219-14f0e479a66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f073c70-235f-42a6-a376-8b6e842cc21b', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:40 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 1073741824 Apr 09 17:37:40 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b5034b-7a7b-49ec-9e80-78df6ad874c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume volume-3f073c70-235f-42a6-a376-8b6e842cc21b (3f073c70-235f-42a6-a376-8b6e842cc21b): created successfully Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b5034b-7a7b-49ec-9e80-78df6ad874c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (e1fb1b23-1fa3-4196-934d-e496727d8292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:40 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8c56fac8-2b8f-4a06-9f6b-2c0d62be2076 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created volume successfully. Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-1a71f036-5b02-4a83-9755-bb34b9fb3998-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-1a71f036-5b02-4a83-9755-bb34b9fb3998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-1a71f036-5b02-4a83-9755-bb34b9fb3998" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-1a71f036-5b02-4a83-9755-bb34b9fb3998" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Deleting offline snapshot 1a71f036-5b02-4a83-9755-bb34b9fb3998 of volume e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] snapshot_file for this snap is: volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca415c-0e4c-497e-acb3-99670ef367a0]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:40 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:40 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:40 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 1073741824" returned: 0 in 0.490s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:40 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 Apr 09 17:37:40 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:40 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.478s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[236630f2-04c6-4a4b-a509-0c640acc73ad]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:40 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 Apr 09 17:37:40 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:40 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-56214222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4483a5a0-75dc-4b0e-97bf-93a93909761d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:38Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Creating volume 4483a5a0-75dc-4b0e-97bf-93a93909761d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:40 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23fd40e-2209-4829-a8fd-750567cded71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da28645-5f8a-4270-8d76-ebe233c877c9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fae01e2-3910-46f3-b7f0-79eb1de0939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:41 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d 1073741824 Apr 09 17:37:41 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:41 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Volume volume-4da28645-5f8a-4270-8d76-ebe233c877c9 (4da28645-5f8a-4270-8d76-ebe233c877c9): created successfully Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fae01e2-3910-46f3-b7f0-79eb1de0939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Flow 'volume_create_manager' (88c67c47-2ad8-4cfd-bfbb-4f59a6a5889d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8b72c589-220b-4bab-9554-268bb2c2aa78 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created volume successfully. Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-4da28645-5f8a-4270-8d76-ebe233c877c9-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-4da28645-5f8a-4270-8d76-ebe233c877c9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:INSERT=66,cinder:SELECT=159,cinder:UPDATE=232,cinder:DELETE=20 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:37:41 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5" returned: 0 in 0.496s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:41 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-quobyte-4da28645-5f8a-4270-8d76-ebe233c877c9" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-4da28645-5f8a-4270-8d76-ebe233c877c9" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a396daee-76a1-4e8d-bd89-604b135be37e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 Apr 09 17:37:41 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:41 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d 1073741824" returned: 0 in 0.528s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d Apr 09 17:37:41 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:41 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.484s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998 Apr 09 17:37:41 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:41 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9 Apr 09 17:37:41 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:41 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d" returned: 0 in 0.419s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.628s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194450521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d02dbae-5a2f-43d1-92f1-da3c9da06c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:38Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Creating volume 4d02dbae-5a2f-43d1-92f1-da3c9da06c5a {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:41 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:41 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8e7e15-ebad-43dc-9c38-4c74f8c0d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4483a5a0-75dc-4b0e-97bf-93a93909761d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471dc018-785b-4adb-b4c5-b20d3b228f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:42 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a 1073741824 Apr 09 17:37:42 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:42 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Volume volume-4483a5a0-75dc-4b0e-97bf-93a93909761d (4483a5a0-75dc-4b0e-97bf-93a93909761d): created successfully Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471dc018-785b-4adb-b4c5-b20d3b228f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (eb466443-5046-45ad-a8e2-18cf99e4f107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:42 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-08392634-97c9-467f-8122-1d3bcd688388 tempest-CreateVolumesFromImageTest-1148350078 None] Created volume successfully. Apr 09 17:37:42 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5.1a71f036-5b02-4a83-9755-bb34b9fb3998" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-1a71f036-5b02-4a83-9755-bb34b9fb3998" released by "_delete_snapshot" :: held 1.962s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" released by "delete_snapshot" :: held 1.975s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:42 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Created reservations ['67dbb7d7-1bd5-4bab-b842-96f3d32a8884', '18e34b78-533b-42b5-bb77-be4404a495a2', '7d50f472-a730-4975-85c6-891720eac3d7', 'b6172609-a8a0-481f-97fa-9e1c011510be'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4da28645-5f8a-4270-8d76-ebe233c877c9" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-4da28645-5f8a-4270-8d76-ebe233c877c9" released by "delete_volume" :: held 0.963s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:42 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Delete snapshot completed successfully. Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-34501d84-429b-4a74-ba06-9d35d5fcc8a4 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-1a71f036-5b02-4a83-9755-bb34b9fb3998-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created reservations ['c2f02b27-1a0a-4d04-99b0-0f1a6e379e09', 'e30aa327-e504-48bc-bc73-1608bd98527a', '56490fc2-0149-4106-92e8-2afd3c379c1b', '99e0bc2d-6e8d-4bda-8ba6-604d11b67176'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-e0450fcc-d98a-468e-b231-1df2dda8a6e5-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:42 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-e0450fcc-d98a-468e-b231-1df2dda8a6e5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:42 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1fd8a-cb4f-4150-9c02-bd8b859f9500]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:42 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a 1073741824" returned: 0 in 0.571s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:42 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 Apr 09 17:37:42 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:42 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a Apr 09 17:37:42 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:42 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.441s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:42 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Deleted volume successfully. Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e3bb4994-7378-4eee-ae04-95e450b2b73d tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-4da28645-5f8a-4270-8d76-ebe233c877c9-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:42 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5" returned: 0 in 0.463s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:42 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5 Apr 09 17:37:42 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:42 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a" returned: 0 in 0.427s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.544s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1167032885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c2e959-6649-487f-b96f-02c2cfe84c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:38Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Creating volume 67c2e959-6649-487f-b96f-02c2cfe84c05 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:42 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5b41a3-0f69-459b-96f3-ea04c0d4e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12b9edd-d117-424a-badd-f2c7c5b42db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:43 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 1073741824 Apr 09 17:37:43 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:43 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Volume volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a (4d02dbae-5a2f-43d1-92f1-da3c9da06c5a): created successfully Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12b9edd-d117-424a-badd-f2c7c5b42db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (0749a6cb-5e49-4e4b-ad2e-39f27c5745b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c077aeda-ee71-43e9-aede-ad543bd0599a tempest-CreateVolumesFromImageTest-1148350078 None] Created volume successfully. Apr 09 17:37:43 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e0450fcc-d98a-468e-b231-1df2dda8a6e5" returned: 0 in 0.430s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-quobyte-e0450fcc-d98a-468e-b231-1df2dda8a6e5" released by "delete_volume" :: held 0.921s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Created reservations ['5762ea8f-5cfc-4d14-8fda-4f9089c0c8d6', '5a344b1d-eb52-4444-a9bb-32470b8f1ef7', '11dc5590-cf7a-42b8-97d2-6e88eed948c7', '931db550-5c55-4b2f-bd45-2090b75d5493'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-3f073c70-235f-42a6-a376-8b6e842cc21b-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:43 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-3f073c70-235f-42a6-a376-8b6e842cc21b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:43 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-quobyte-3f073c70-235f-42a6-a376-8b6e842cc21b" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:43 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-3f073c70-235f-42a6-a376-8b6e842cc21b" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 1073741824" returned: 0 in 0.554s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ce14b3-25ac-454e-bc93-815e93b8c459]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:43 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 Apr 09 17:37:43 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:43 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b Apr 09 17:37:43 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:43 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.430s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Deleted volume successfully. Apr 09 17:37:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d6265ef-0da3-42d8-9b48-6ec5dc9e25c0 tempest-VolumesSnapshotListTestJSON-57769890 None] Lock "cinder-e0450fcc-d98a-468e-b231-1df2dda8a6e5-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:44 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b" returned: 0 in 0.507s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:44 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b Apr 09 17:37:44 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:44 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05" returned: 0 in 0.510s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.352s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308618997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8ca348-c118-40b4-aadf-b15d5644c296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:39Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Creating volume 7b8ca348-c118-40b4-aadf-b15d5644c296 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:44 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d464e7-5c62-4a62-bdf9-4b5a89b8ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c2e959-6649-487f-b96f-02c2cfe84c05', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b32fa73-eb28-4363-b3b0-9c8b1c368126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:44 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 1073741824 Apr 09 17:37:44 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:44 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Volume volume-67c2e959-6649-487f-b96f-02c2cfe84c05 (67c2e959-6649-487f-b96f-02c2cfe84c05): created successfully Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b32fa73-eb28-4363-b3b0-9c8b1c368126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (6bd42259-d4ba-4599-9411-83d463d6270b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:44 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-72fbae73-6966-4e14-aaf5-04bb05a84b74 tempest-CreateVolumesFromImageTest-1148350078 None] Created volume successfully. Apr 09 17:37:44 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 1073741824" returned: 0 in 0.575s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:44 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3f073c70-235f-42a6-a376-8b6e842cc21b" returned: 0 in 0.631s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-3f073c70-235f-42a6-a376-8b6e842cc21b" released by "delete_volume" :: held 1.172s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:44 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 Apr 09 17:37:44 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created reservations ['c3a61230-ce13-460c-8a3c-8dd04dbe7dab', '9e0e559c-fb80-4eab-a865-80225d090dbf', 'be89f891-e1b4-418d-897b-34938eb30a98', '8d2b70cc-de5f-4a38-a273-b405ab787762'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:44 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:44 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:45 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296" returned: 0 in 0.439s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.183s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-822178154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f47c312-d51d-432b-891a-e1c86e4213a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91251f5c50c348298b0c589a8e476151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:39Z,use_quota=True,user_id='60dcd141fc5d4c8fbfd5485e7116e074',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Creating volume 5f47c312-d51d-432b-891a-e1c86e4213a0 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:45 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:45 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 1073741824 Apr 09 17:37:45 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d24bf0-913c-463b-bc24-6de380338dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8ca348-c118-40b4-aadf-b15d5644c296', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb98873-ff18-4d41-9c7c-b0ea8299d267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:45 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Volume volume-7b8ca348-c118-40b4-aadf-b15d5644c296 (7b8ca348-c118-40b4-aadf-b15d5644c296): created successfully Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb98873-ff18-4d41-9c7c-b0ea8299d267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (ceff3cb1-3e09-4d98-934c-ceabe166f190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:45 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a66b06d4-5e67-41bc-8727-3fe33d0c64c4 tempest-CreateVolumesFromImageTest-1148350078 None] Created volume successfully. Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:45 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Flow 'volume_create_manager' (cfab9896-63e9-4c82-8397-1aee85f14ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4e0813-5181-41ef-a75c-8f350f232a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.565s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4e0813-5181-41ef-a75c-8f350f232a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76addaec-beba-4d04-ada2-3fe4b1ba9451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73539ddcf9a4bc69bc1830c4a69cf0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:45Z,use_quota=True,user_id='b6b90aac84a64d7c8c27ee87c99afd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e9976-b594-4191-9a6b-0d8c1d15eeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e9976-b594-4191-9a6b-0d8c1d15eeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182b3cd8-d006-431a-b9c8-13bb1734e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182b3cd8-d006-431a-b9c8-13bb1734e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76addaec-beba-4d04-ada2-3fe4b1ba9451', 'volume_name': 'volume-76addaec-beba-4d04-ada2-3fe4b1ba9451', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51b3fca-174d-44e5-9972-bdd849b6861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51b3fca-174d-44e5-9972-bdd849b6861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77048249-5284-46e8-8a04-cfe7d77a514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:45 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Volume 76addaec-beba-4d04-ada2-3fe4b1ba9451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76addaec-beba-4d04-ada2-3fe4b1ba9451', 'volume_size': 1} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:45 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Deleted volume successfully. Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-aa5c02ca-1f78-4a0a-96d1-b28c87a51102 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-3f073c70-235f-42a6-a376-8b6e842cc21b-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-quobyte-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[106fa374-c90f-4e3b-b42b-2e0e34ca7901]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:45 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 1073741824" returned: 0 in 0.551s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:45 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 Apr 09 17:37:45 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:45 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe Apr 09 17:37:45 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:46 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.105s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-565336546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07b0c60-26ab-414b-a55d-ed523b7c9fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:39Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Creating volume d07b0c60-26ab-414b-a55d-ed523b7c9fb7 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:46 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:46 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df016b84-f45d-4188-bdaa-828c9a05cef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f47c312-d51d-432b-891a-e1c86e4213a0', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dc6030-493c-4347-9979-18403a1b0002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:46 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 1073741824 Apr 09 17:37:46 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe" returned: 0 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:46 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Volume volume-5f47c312-d51d-432b-891a-e1c86e4213a0 (5f47c312-d51d-432b-891a-e1c86e4213a0): created successfully Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dc6030-493c-4347-9979-18403a1b0002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:46 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe Apr 09 17:37:46 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Flow 'volume_create_manager' (7accabfb-46ae-40cb-ba74-75ed664adcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1abd4a39-aba3-4c69-908c-45f15da10218 tempest-CreateVolumesFromImageTest-1148350078 None] Created volume successfully. Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-5f47c312-d51d-432b-891a-e1c86e4213a0-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-5f47c312-d51d-432b-891a-e1c86e4213a0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-quobyte-5f47c312-d51d-432b-891a-e1c86e4213a0" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-5f47c312-d51d-432b-891a-e1c86e4213a0" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cd590c-845e-488d-92ce-31e0d3f42a02]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:46 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 Apr 09 17:37:46 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:46 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe" released by "delete_volume" :: held 0.989s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:46 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 1073741824" returned: 0 in 0.539s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created reservations ['af4f5a7a-3976-4f8d-ba57-fe388ed1d89b', '179ddabf-a3c6-445a-b67e-686dffb4a0da', '3e4b6391-c47b-431f-97d1-effe4559b8e2', 'fb4dad79-c138-45e8-b808-d969468c6655'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:46 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 Apr 09 17:37:46 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:46 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:46 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:47 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:47 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0 Apr 09 17:37:47 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:47 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7" returned: 0 in 0.415s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76addaec-beba-4d04-ada2-3fe4b1ba9451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73539ddcf9a4bc69bc1830c4a69cf0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:45Z,use_quota=True,user_id='b6b90aac84a64d7c8c27ee87c99afd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Creating volume 76addaec-beba-4d04-ada2-3fe4b1ba9451 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:47 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2aa938-104f-4c75-9f95-24f6ed1151cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f47b605-7355-4459-ad2d-bd029f5de8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:47 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 1073741824 Apr 09 17:37:47 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:47 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Volume volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 (d07b0c60-26ab-414b-a55d-ed523b7c9fb7): created successfully Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f47b605-7355-4459-ad2d-bd029f5de8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (4e9639a2-912d-4edd-aac9-2f894eabf4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-59f99cd0-f04b-493d-a57e-46e79fc082ab tempest-VolumesActionsTest-1117277206 None] Created volume successfully. Apr 09 17:37:47 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.419s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Deleted volume successfully. Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0e28b3cf-4309-405b-97fb-54c7b593e029 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-239b0c8a-267b-4fb3-99cc-ca8fb9ea1afe-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:47 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5f47c312-d51d-432b-891a-e1c86e4213a0" returned: 0 in 0.457s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-5f47c312-d51d-432b-891a-e1c86e4213a0" released by "delete_volume" :: held 0.986s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Created reservations ['0c1da4c0-5089-4809-88c6-b809964d4f05', 'cacde3ca-59a0-4ef5-9555-15172dc39de9', 'db8a7eb2-c7e3-4b74-9e74-01b4a3dbbb3a', 'a693a51d-8bd9-444a-9286-ee5ce41818e7'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-d07b0c60-26ab-414b-a55d-ed523b7c9fb7-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Lock "cinder-d07b0c60-26ab-414b-a55d-ed523b7c9fb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:47 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:47 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-quobyte-d07b0c60-26ab-414b-a55d-ed523b7c9fb7" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-d07b0c60-26ab-414b-a55d-ed523b7c9fb7" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1f31af-b5fc-42b6-a04e-c98276bc9fd3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:47 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 1073741824" returned: 0 in 0.564s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:47 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 Apr 09 17:37:47 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:47 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 Apr 09 17:37:47 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-27011559-07bb-4096-bb9a-c253babf1771-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-27011559-07bb-4096-bb9a-c253babf1771-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-quobyte-27011559-07bb-4096-bb9a-c253babf1771" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-27011559-07bb-4096-bb9a-c253babf1771" acquired by "delete_volume" :: waited 0.026s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569768d-ec06-45aa-8696-d35915e93793]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:47 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 Apr 09 17:37:47 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:48 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Deleted volume successfully. Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-40d0b596-f23e-4617-a9eb-e25fed10eeae tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-5f47c312-d51d-432b-891a-e1c86e4213a0-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:48 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:48 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7" returned: 0 in 0.533s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77048249-5284-46e8-8a04-cfe7d77a514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76addaec-beba-4d04-ada2-3fe4b1ba9451', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a92ed2-ced0-4fa9-bdd5-ca4af3cc621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:48 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7 Apr 09 17:37:48 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:48 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Volume volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 (76addaec-beba-4d04-ada2-3fe4b1ba9451): created successfully Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a92ed2-ced0-4fa9-bdd5-ca4af3cc621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Flow 'volume_create_manager' (cfab9896-63e9-4c82-8397-1aee85f14ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3ed7d6dd-7b46-4f6a-a8b6-30c4d45cfd2c tempest-CinderUnicodeTest-2045695850 None] Created volume successfully. Apr 09 17:37:48 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771" returned: 0 in 0.530s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:48 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771 Apr 09 17:37:48 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-7b8ca348-c118-40b4-aadf-b15d5644c296-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:48 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-7b8ca348-c118-40b4-aadf-b15d5644c296-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d07b0c60-26ab-414b-a55d-ed523b7c9fb7" returned: 0 in 0.444s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-d07b0c60-26ab-414b-a55d-ed523b7c9fb7" released by "delete_volume" :: held 1.028s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-quobyte-7b8ca348-c118-40b4-aadf-b15d5644c296" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-7b8ca348-c118-40b4-aadf-b15d5644c296" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1023e71d-473c-499b-8fc5-c61aa8db1c1b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Flow 'volume_create_manager' (fcadf87c-eb78-4818-b295-8ab7eedc0ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a94ba-85e4-40f7-bdf6-88f693f95090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:48 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 Apr 09 17:37:48 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89a94ba-85e4-40f7-bdf6-88f693f95090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1955825261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0201a8d5-c796-4893-9fe9-6164fda655c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73539ddcf9a4bc69bc1830c4a69cf0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:49Z,use_quota=True,user_id='b6b90aac84a64d7c8c27ee87c99afd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f69c8ac-4dc5-41dd-95d6-89b3f02872c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f69c8ac-4dc5-41dd-95d6-89b3f02872c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85879822-9ef3-4d48-9cf7-121abecf9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85879822-9ef3-4d48-9cf7-121abecf9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0201a8d5-c796-4893-9fe9-6164fda655c6', 'volume_name': 'volume-0201a8d5-c796-4893-9fe9-6164fda655c6', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd37db6a-5bfd-440f-b1ef-5079a9bd4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd37db6a-5bfd-440f-b1ef-5079a9bd4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee96a4cd-2edc-4476-b4c0-222be5ce3f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:48 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Volume 0201a8d5-c796-4893-9fe9-6164fda655c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0201a8d5-c796-4893-9fe9-6164fda655c6', 'volume_size': 1} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1955825261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0201a8d5-c796-4893-9fe9-6164fda655c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73539ddcf9a4bc69bc1830c4a69cf0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:49Z,use_quota=True,user_id='b6b90aac84a64d7c8c27ee87c99afd85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Creating volume 0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:48 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:48 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 1073741824 Apr 09 17:37:48 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Created reservations ['30545a96-9fa0-4591-b408-690809cc019c', 'c49cab9e-bb14-416b-8c08-592164985e31', 'dfccfd3f-d4b4-447e-a2a3-a232ff6f8d36', '384b70f7-09eb-4c1b-b02f-2c84e3225bf3'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:48 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-27011559-07bb-4096-bb9a-c253babf1771" returned: 0 in 0.548s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-27011559-07bb-4096-bb9a-c253babf1771" released by "delete_volume" :: held 1.113s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:49 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:49 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created reservations ['ef409092-f0fe-4f0e-9714-6c22769ac000', '4c28fe06-52fc-45b4-b9b2-15cd82a0a95a', 'ac784c94-220c-420b-b7c4-9d73a6681393', '139536a4-b7e3-4473-a77c-33d136892252'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:49 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:49 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:49 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296" returned: 0 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:49 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296 Apr 09 17:37:49 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:49 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 1073741824" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:49 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 Apr 09 17:37:49 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:49 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Deleted volume successfully. Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b1eea0d2-e196-4a78-aa2d-574ac96874b9 tempest-VolumesActionsTest-753674556 None] Lock "cinder-d07b0c60-26ab-414b-a55d-ed523b7c9fb7-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:49 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.485s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Deleted volume successfully. Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b541556e-6ac7-41cf-a10d-0f31f6f3ae39 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-27011559-07bb-4096-bb9a-c253babf1771-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:49 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7b8ca348-c118-40b4-aadf-b15d5644c296" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-7b8ca348-c118-40b4-aadf-b15d5644c296" released by "delete_volume" :: held 0.986s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Created reservations ['960f5200-fac0-42bf-bf2a-6c2654a37031', 'c75890b0-2945-4501-a715-9580adf48722', 'c3417529-5b7b-4522-b63f-bffc215debfe', 'a7eb2727-64a3-4ff1-b45a-eeee8f02a54e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:49 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:49 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:49 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee96a4cd-2edc-4476-b4c0-222be5ce3f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0201a8d5-c796-4893-9fe9-6164fda655c6', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb10847c-0f0a-43b7-b3c0-685ed18cc29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:49 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Volume volume-0201a8d5-c796-4893-9fe9-6164fda655c6 (0201a8d5-c796-4893-9fe9-6164fda655c6): created successfully Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb10847c-0f0a-43b7-b3c0-685ed18cc29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Flow 'volume_create_manager' (fcadf87c-eb78-4818-b295-8ab7eedc0ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e515bc1d-39d5-4501-bf76-b0235e6db318 tempest-CinderUnicodeTest-2045695850 None] Created volume successfully. Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-470b6567-8212-4d20-a4fc-0375c68b7e5c-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (b81dfa82-808a-403b-8a71-7ecc41737cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2de37a-126f-415f-a91d-090dc55363ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-470b6567-8212-4d20-a4fc-0375c68b7e5c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2de37a-126f-415f-a91d-090dc55363ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1782151343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d103a253-a2ec-4036-b552-d2ba702e7e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:50Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3e258b-5ad4-4843-841a-c57a88c28fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3e258b-5ad4-4843-841a-c57a88c28fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f0fb9b-1aab-4783-a1f8-4af194334a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f0fb9b-1aab-4783-a1f8-4af194334a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd103a253-a2ec-4036-b552-d2ba702e7e56', 'volume_name': 'volume-d103a253-a2ec-4036-b552-d2ba702e7e56', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecc1fdd-4393-4d37-bbf3-ce6dc185945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ecc1fdd-4393-4d37-bbf3-ce6dc185945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5bf275-d3f1-4826-9c39-e18c37e43e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:50 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Volume d103a253-a2ec-4036-b552-d2ba702e7e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d103a253-a2ec-4036-b552-d2ba702e7e56', 'volume_size': 1} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1782151343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d103a253-a2ec-4036-b552-d2ba702e7e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:50Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Creating volume d103a253-a2ec-4036-b552-d2ba702e7e56 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:50 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:50 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 1073741824 Apr 09 17:37:50 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-quobyte-470b6567-8212-4d20-a4fc-0375c68b7e5c" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-470b6567-8212-4d20-a4fc-0375c68b7e5c" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7557a2d5-f2e8-4c21-bac8-10762db58a57]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:50 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c Apr 09 17:37:50 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:50 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.485s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:50 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Deleted volume successfully. Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6d5fce7c-bea2-4206-86be-9ee9f36177a0 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-7b8ca348-c118-40b4-aadf-b15d5644c296-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:50 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 1073741824" returned: 0 in 0.484s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:50 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 Apr 09 17:37:50 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:50 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c" returned: 0 in 0.505s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:50 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c Apr 09 17:37:50 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-67c2e959-6649-487f-b96f-02c2cfe84c05-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-67c2e959-6649-487f-b96f-02c2cfe84c05-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-quobyte-67c2e959-6649-487f-b96f-02c2cfe84c05" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-67c2e959-6649-487f-b96f-02c2cfe84c05" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cd5045-198d-4695-a08e-17ea27828ebc]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:51 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 Apr 09 17:37:51 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:51 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56" returned: 0 in 0.513s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.098s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Creating offline snapshot 0aea87fd-8010-460e-ad30-2c76d5a5fb1c of volume 0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:37:51 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5bf275-d3f1-4826-9c39-e18c37e43e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d103a253-a2ec-4036-b552-d2ba702e7e56', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc01078e-69a7-4846-b7e8-77d52d5d7588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1237fd-bbaf-45c1-83be-e9aef91a710d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-470b6567-8212-4d20-a4fc-0375c68b7e5c" returned: 0 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:51 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Volume volume-d103a253-a2ec-4036-b552-d2ba702e7e56 (d103a253-a2ec-4036-b552-d2ba702e7e56): created successfully Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc01078e-69a7-4846-b7e8-77d52d5d7588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (b81dfa82-808a-403b-8a71-7ecc41737cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-470b6567-8212-4d20-a4fc-0375c68b7e5c" released by "delete_volume" :: held 1.038s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:51 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-353a1755-42d4-47f2-827f-6a391c6c9716 tempest-VolumesActionsTest-1117277206 None] Created volume successfully. Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created reservations ['47d9094f-fb81-44e7-b9f4-74fa37342162', 'b5deebea-15d8-4e2d-93e0-f25799d8e805', '9c4b8a7b-4074-4394-936d-918bdee6e88e', '1c79337a-5631-46b9-a354-c244f42e20db'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:51 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 Apr 09 17:37:51 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:51 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:51 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:51 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05" returned: 0 in 0.573s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:51 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05 Apr 09 17:37:51 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:51 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6" returned: 0 in 0.527s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:51 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.437s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:51 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Deleted volume successfully. Apr 09 17:37:51 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c 1G Apr 09 17:37:51 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5f579ea1-7c3d-450e-b9f8-e4aed9095504 tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-470b6567-8212-4d20-a4fc-0375c68b7e5c-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:51 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-67c2e959-6649-487f-b96f-02c2cfe84c05" returned: 0 in 0.422s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-67c2e959-6649-487f-b96f-02c2cfe84c05" released by "delete_volume" :: held 1.031s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Created reservations ['08c0d7c0-4357-42d9-9744-c9b892b98887', '727b8da7-0dbd-4fbc-932a-31693474a172', '3fce906d-6d90-439f-9c74-d8070fa27810', '3ee64265-396f-4bdf-be45-baeb1e33312e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:52 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:52 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-d103a253-a2ec-4036-b552-d2ba702e7e56-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "cinder-quobyte-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c 1G" returned: 0 in 0.622s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0201a8d5-c796-4893-9fe9-6164fda655c6 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Lock "cinder-d103a253-a2ec-4036-b552-d2ba702e7e56-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe" acquired by "delete_volume" :: waited 0.028s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:52 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0201a8d5-c796-4893-9fe9-6164fda655c6 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c Apr 09 17:37:52 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273002d-7966-4143-bd9f-3056368ea571]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Acquiring lock "cinder-quobyte-d103a253-a2ec-4036-b552-d2ba702e7e56" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-d103a253-a2ec-4036-b552-d2ba702e7e56" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd4b617-2ef4-41aa-8205-0585a20f3c1d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe Apr 09 17:37:52 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:52 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:52 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Deleted volume successfully. Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddb2bb95-763d-46a1-95cd-9aa449140a89 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-67c2e959-6649-487f-b96f-02c2cfe84c05-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:52 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 Apr 09 17:37:52 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:52 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0201a8d5-c796-4893-9fe9-6164fda655c6 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:52 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c is being set with open permissions: ugo+rw Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c Apr 09 17:37:52 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:52 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe" returned: 0 in 0.490s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe Apr 09 17:37:52 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:52 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56" returned: 0 in 0.504s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:52 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56 Apr 09 17:37:52 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-quobyte-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c808b3-29c2-4ab6-95e1-fd27c3012604]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:53 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a Apr 09 17:37:53 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:53 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info Apr 09 17:37:53 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe" returned: 0 in 0.457s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-quobyte-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe" released by "delete_volume" :: held 0.972s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Created reservations ['8609ece9-cffc-481f-a2b4-4e3a91af2453', 'e701d5e2-fb64-44e3-a1bf-35ceb22b6aff', 'ba9cb1fb-497a-4c05-94b6-59fd1a166c30', 'fc666331-f738-42f2-a905-fcf734d5b88d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:53 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d103a253-a2ec-4036-b552-d2ba702e7e56" returned: 0 in 0.479s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Lock "cinder-quobyte-d103a253-a2ec-4036-b552-d2ba702e7e56" released by "delete_volume" :: held 1.011s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Created reservations ['3fe9d64c-9a74-40a0-9c4c-5eb491ea824b', '552e504c-8f1b-4950-8fd5-81f176d1a257', 'b9c35b8d-c895-4a95-a91b-255ae20e2cc8', 'fe79e0b1-23b5-4ab8-adb5-39472fab7525'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:53 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:53 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:53 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:53 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a" returned: 0 in 0.566s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:53 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a Apr 09 17:37:53 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:53 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info is being set with open permissions: ugo+rw Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:53 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info Apr 09 17:37:53 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:53 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.414s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Deleted volume successfully. Apr 09 17:37:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-17e03676-d159-4ec2-b8e4-0473acbd0b5c tempest-CreateVolumesFromSourceVolumeTest-1929315504 None] Lock "cinder-dc0a0cd9-ad9a-478a-9514-f9c2c255b3fe-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:54 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.431s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Deleted volume successfully. Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a160f2af-d7e9-45d9-9d57-b53a70675be1 tempest-VolumesActionsTest-753674556 None] Lock "cinder-d103a253-a2ec-4036-b552-d2ba702e7e56-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:54 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a" returned: 0 in 0.448s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a" released by "delete_volume" :: held 1.057s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:54 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.info" returned: 0 in 0.451s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Created reservations ['34f69c33-9978-48be-a43b-762c481e3db3', 'e0d93c31-a64b-4e4c-b0c0-65a9d056c8c1', 'fa4f4118-897e-47d4-9f3a-2e721b9870ee', '8037639c-484e-4866-942e-c4c53cf618b1'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-185df5c7-c08d-4eba-82c9-5cbdc91c28b6 tempest-CinderUnicodeTest-2045695850 None] Create snapshot completed successfully Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:54 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:54 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:54 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.505s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Deleted volume successfully. Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (d6492fa5-b4d2-4caf-bbcd-09105196d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b94b2c-8bec-4305-82c3-03ede063d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b94b2c-8bec-4305-82c3-03ede063d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411176315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62cb95e-aea4-486f-8d76-a6fb0b4abdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:55Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6971eaf4-0fc4-49c9-a90c-c3ba9c16a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6971eaf4-0fc4-49c9-a90c-c3ba9c16a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a970051-895f-4ac3-8535-82c651065078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a970051-895f-4ac3-8535-82c651065078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62cb95e-aea4-486f-8d76-a6fb0b4abdf4', 'volume_name': 'volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c509685d-3b24-4be9-bdc8-4eb6ef24dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c509685d-3b24-4be9-bdc8-4eb6ef24dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500bf1e7-465b-4a4e-8f4b-c2db032315bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Volume c62cb95e-aea4-486f-8d76-a6fb0b4abdf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4', 'volume_size': 1} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411176315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62cb95e-aea4-486f-8d76-a6fb0b4abdf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ec85eb43ff4e87abf87b4580f08c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:55Z,use_quota=True,user_id='f157e4cedfd646b0af10fe4dd73b2222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Creating volume c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:54 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-62b4e056-691d-4945-a299-e78b34234dda tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-4d02dbae-5a2f-43d1-92f1-da3c9da06c5a-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:54 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 1073741824 Apr 09 17:37:54 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-4483a5a0-75dc-4b0e-97bf-93a93909761d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-4483a5a0-75dc-4b0e-97bf-93a93909761d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "cinder-quobyte-4483a5a0-75dc-4b0e-97bf-93a93909761d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-4483a5a0-75dc-4b0e-97bf-93a93909761d" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-0aea87fd-8010-460e-ad30-2c76d5a5fb1c-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d96a580-e853-4983-af2a-fa15d770a879]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-0aea87fd-8010-460e-ad30-2c76d5a5fb1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-quobyte-0201a8d5-c796-4893-9fe9-6164fda655c6" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-0201a8d5-c796-4893-9fe9-6164fda655c6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-quobyte-0aea87fd-8010-460e-ad30-2c76d5a5fb1c" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-0aea87fd-8010-460e-ad30-2c76d5a5fb1c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Deleting offline snapshot 0aea87fd-8010-460e-ad30-2c76d5a5fb1c of volume 0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] snapshot_file for this snap is: volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[103e8696-68f6-4435-93e3-eb876f6d3abc]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:55 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d Apr 09 17:37:55 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:55 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c Apr 09 17:37:55 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:55 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 1073741824" returned: 0 in 0.623s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:55 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 Apr 09 17:37:55 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:55 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d" returned: 0 in 0.617s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:55 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d Apr 09 17:37:55 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:56 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4" returned: 0 in 0.491s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500bf1e7-465b-4a4e-8f4b-c2db032315bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e4ed13-d787-452d-bba1-429bbba32e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:56 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Volume volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 (c62cb95e-aea4-486f-8d76-a6fb0b4abdf4): created successfully Apr 09 17:37:56 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e4ed13-d787-452d-bba1-429bbba32e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Flow 'volume_create_manager' (d6492fa5-b4d2-4caf-bbcd-09105196d520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c" returned: 0 in 0.643s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0201a8d5-c796-4893-9fe9-6164fda655c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:37:56 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2612c7b2-0c76-4232-b618-3f5e24078002 tempest-VolumesActionsTest-1117277206 None] Created volume successfully. Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[69085c36-79f2-4f29-a523-f425bf2a049d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:56 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 Apr 09 17:37:56 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (13ba0a92-553a-44fe-b433-00c77135d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad36f140-c36a-4c15-b9b5-f345d9aae817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad36f140-c36a-4c15-b9b5-f345d9aae817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1951464839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943f18ca-0434-40ed-8282-15dfd96dfc0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5672afc795e4b3f9aec98f5ab0d42e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:56Z,use_quota=True,user_id='84f553bbe5c749af969e7649b59f742f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367a31d7-44ed-4343-a54b-d3bf6ea258aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367a31d7-44ed-4343-a54b-d3bf6ea258aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d45b6f7-5315-4c43-b137-7f2bd10040e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d45b6f7-5315-4c43-b137-7f2bd10040e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943f18ca-0434-40ed-8282-15dfd96dfc0d', 'volume_name': 'volume-943f18ca-0434-40ed-8282-15dfd96dfc0d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f930157-da35-4496-b667-78009a699689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f930157-da35-4496-b667-78009a699689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3498757-08ea-4221-b49c-bc7bfb7d3ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:56 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Volume 943f18ca-0434-40ed-8282-15dfd96dfc0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943f18ca-0434-40ed-8282-15dfd96dfc0d', 'volume_size': 1} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1951464839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943f18ca-0434-40ed-8282-15dfd96dfc0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5672afc795e4b3f9aec98f5ab0d42e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:37:56Z,use_quota=True,user_id='84f553bbe5c749af969e7649b59f742f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Creating volume 943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:37:56 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:56 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d 1073741824 Apr 09 17:37:56 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:56 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4483a5a0-75dc-4b0e-97bf-93a93909761d" returned: 0 in 0.452s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-quobyte-4483a5a0-75dc-4b0e-97bf-93a93909761d" released by "delete_volume" :: held 1.098s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Created reservations ['3bf4215e-6994-465d-9529-ef42df88611d', '6526b61f-7d1c-4bdb-81f4-6b6afa92e050', '9cf8339c-172b-4a43-90ec-2c00f0c048f5', '08174b92-5bf9-4174-866f-b7bbfd4dd322'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:56 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:56 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:56 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6" returned: 0 in 0.598s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:56 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c Apr 09 17:37:56 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:56 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d 1073741824" returned: 0 in 0.525s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:56 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:37:56 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:56 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:56 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Deleted volume successfully. Apr 09 17:37:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8bec145a-a60d-42d3-884a-f717d57255a8 tempest-CreateVolumesFromImageTest-1148350078 None] Lock "cinder-4483a5a0-75dc-4b0e-97bf-93a93909761d-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:57 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c" returned: 0 in 0.528s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:57 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c Apr 09 17:37:57 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:57 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.542s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3498757-08ea-4221-b49c-bc7bfb7d3ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943f18ca-0434-40ed-8282-15dfd96dfc0d', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081968f7-be3a-45e1-9b40-d223ff81bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:37:57 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Volume volume-943f18ca-0434-40ed-8282-15dfd96dfc0d (943f18ca-0434-40ed-8282-15dfd96dfc0d): created successfully Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081968f7-be3a-45e1-9b40-d223ff81bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (13ba0a92-553a-44fe-b433-00c77135d182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:37:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-64f57b3f-6caf-41e2-afed-bc5b941ed424 tempest-VolumeDependencyTests-1757775827 None] Created volume successfully. Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "cinder-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "cinder-quobyte-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-quobyte-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e08ab-e36d-4c11-97de-76fc980711ee]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:57 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 Apr 09 17:37:57 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:57 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6.0aea87fd-8010-460e-ad30-2c76d5a5fb1c" returned: 0 in 0.517s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-0aea87fd-8010-460e-ad30-2c76d5a5fb1c" released by "_delete_snapshot" :: held 2.347s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-0201a8d5-c796-4893-9fe9-6164fda655c6" released by "delete_snapshot" :: held 2.359s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Created reservations ['c70e2399-ecf2-4e1e-954b-f93eb8cbdbaa', '2bbf0a69-e0a1-4305-aba5-d9120f368a64', 'dc2e5df2-1905-43a9-9ba3-e7421d4605de', 'd6c3e061-3e0a-4c39-9353-98178793975b'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Delete snapshot completed successfully. Apr 09 17:37:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7e96ac7d-e74b-4646-884e-49ba88159c04 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-0aea87fd-8010-460e-ad30-2c76d5a5fb1c-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:58 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:58 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4 Apr 09 17:37:58 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Creating offline snapshot bb5bff08-a655-4bb2-bde1-c1560047deda of volume 943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04598c-2eeb-4b07-9d0b-bd580e14b74d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-0201a8d5-c796-4893-9fe9-6164fda655c6-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-0201a8d5-c796-4893-9fe9-6164fda655c6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:58 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4" returned: 0 in 0.501s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-quobyte-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4" released by "delete_volume" :: held 1.120s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:58 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:37:58 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-quobyte-0201a8d5-c796-4893-9fe9-6164fda655c6" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-0201a8d5-c796-4893-9fe9-6164fda655c6" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166416c-7229-44fe-887d-8ffc55d727b3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Created reservations ['6742b251-65a3-4865-85b8-7323fbf8262b', '272de45d-41c9-4ec9-824a-ba9f2e286a63', '200cb2f0-534f-465c-af9b-97d3e711d882', 'ec1ef573-50ee-4c47-9284-f6ca3f65568a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:58 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 Apr 09 17:37:58 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:58 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:58 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:59 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:59 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda 1G Apr 09 17:37:59 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:59 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.405s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:37:59 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Deleted volume successfully. Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f1122966-7e47-4216-b3de-e66a6355e626 tempest-VolumesActionsTest-1117277206 None] Lock "cinder-c62cb95e-aea4-486f-8d76-a6fb0b4abdf4-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:59 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6" returned: 0 in 0.496s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:59 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6 Apr 09 17:37:59 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:59 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda 1G" returned: 0 in 0.482s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943f18ca-0434-40ed-8282-15dfd96dfc0d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:59 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943f18ca-0434-40ed-8282-15dfd96dfc0d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda Apr 09 17:37:59 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:59 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0201a8d5-c796-4893-9fe9-6164fda655c6" returned: 0 in 0.447s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-0201a8d5-c796-4893-9fe9-6164fda655c6" released by "delete_volume" :: held 0.988s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Created reservations ['b4c5ed40-4d08-45c7-949c-30e0aed644f1', '0989d4a5-1d9a-4fc3-8131-f454c410f325', 'ae42d815-372b-4c80-b417-dde0d6db3d27', 'b1e5ec33-af33-4c36-afb7-f3d65ecb75b9'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:37:59 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:37:59 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:37:59 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943f18ca-0434-40ed-8282-15dfd96dfc0d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda" returned: 0 in 0.485s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:37:59 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda is being set with open permissions: ugo+rw Apr 09 17:37:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:00 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda Apr 09 17:38:00 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:00 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Deleted volume successfully. Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-db4e7031-efa3-411a-a8d8-faad9b368478 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-0201a8d5-c796-4893-9fe9-6164fda655c6-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:00 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda" returned: 0 in 0.447s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:00 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info Apr 09 17:38:00 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-76addaec-beba-4d04-ada2-3fe4b1ba9451-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-76addaec-beba-4d04-ada2-3fe4b1ba9451-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "cinder-quobyte-76addaec-beba-4d04-ada2-3fe4b1ba9451" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-76addaec-beba-4d04-ada2-3fe4b1ba9451" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7373e6a3-310d-4e15-b5ae-2c815e3ed94c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:00 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 Apr 09 17:38:00 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:00 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info" returned: 0 in 0.480s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:00 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info is being set with open permissions: ugo+rw Apr 09 17:38:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:00 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info Apr 09 17:38:00 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:01 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451" returned: 0 in 0.506s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:01 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451 Apr 09 17:38:01 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:01 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.info" returned: 0 in 0.499s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:01 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e113638b-59e3-4913-bc32-537923cd12bd tempest-VolumeDependencyTests-1757775827 None] Create snapshot completed successfully Apr 09 17:38:01 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-76addaec-beba-4d04-ada2-3fe4b1ba9451" returned: 0 in 0.477s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-quobyte-76addaec-beba-4d04-ada2-3fe4b1ba9451" released by "delete_volume" :: held 1.008s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Created reservations ['8194fde8-776f-430f-8e26-066b466eb04a', '8ef836c9-d4ba-4946-9d88-619cecf64b14', '257c319e-b90b-494b-ab4d-dacffa709586', '2c165533-59d2-49c0-9c83-bf93647cea42'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (de042c03-7a43-46ed-984e-775e5ab312bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa41147-6411-4d57-9b45-f32f3f636054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:01 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:01 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa41147-6411-4d57-9b45-f32f3f636054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-761480586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0544af23-29e0-406c-9592-401252a5aba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5672afc795e4b3f9aec98f5ab0d42e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb5bff08-a655-4bb2-bde1-c1560047deda,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:02Z,use_quota=True,user_id='84f553bbe5c749af969e7649b59f742f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a943f4d6-e90e-4ca3-8969-2ed905fa1068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a943f4d6-e90e-4ca3-8969-2ed905fa1068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327cb711-1f35-4430-8ea3-24c6523b4903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327cb711-1f35-4430-8ea3-24c6523b4903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0544af23-29e0-406c-9592-401252a5aba1', 'volume_name': 'volume-0544af23-29e0-406c-9592-401252a5aba1', 'volume_size': 1, 'snapshot_id': 'bb5bff08-a655-4bb2-bde1-c1560047deda'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7060f80a-25b5-4f85-bf7e-ea908049d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7060f80a-25b5-4f85-bf7e-ea908049d329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a72c20b-2392-4e21-b5a7-68f32a1602f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:02 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Volume 0544af23-29e0-406c-9592-401252a5aba1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0544af23-29e0-406c-9592-401252a5aba1', 'volume_size': 1, 'snapshot_id': 'bb5bff08-a655-4bb2-bde1-c1560047deda'} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-bb5bff08-a655-4bb2-bde1-c1560047deda-0544af23-29e0-406c-9592-401252a5aba1" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-bb5bff08-a655-4bb2-bde1-c1560047deda-0544af23-29e0-406c-9592-401252a5aba1" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Creating volume 0544af23-29e0-406c-9592-401252a5aba1 from snapshot bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-0544af23-29e0-406c-9592-401252a5aba1" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0544af23-29e0-406c-9592-401252a5aba1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] snapshot: bb5bff08-a655-4bb2-bde1-c1560047deda, volume: 0544af23-29e0-406c-9592-401252a5aba1, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[77951244-77b1-4e74-b46d-3ce3fa626ca6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:02 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda Apr 09 17:38:02 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:02 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.451s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:02 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Deleted volume successfully. Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-8b8f5f9e-d745-42e6-a0f4-6eaa71e72746 tempest-CinderUnicodeTest-2045695850 None] Lock "cinder-76addaec-beba-4d04-ada2-3fe4b1ba9451-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:02 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda" returned: 0 in 0.517s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943f18ca-0434-40ed-8282-15dfd96dfc0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[529ddb6e-4408-4efe-adf3-70496151e042]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:02 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:38:02 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:03 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.550s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:03 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:38:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:03 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 Apr 09 17:38:03 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:05 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1" returned: 0 in 2.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4c7db4-d806-46e8-bd4d-edad9ce2ab8b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:05 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:38:05 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:06 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.687s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:38:06 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Converted 1024.00 MB image at 416.39 MB/s Apr 09 17:38:06 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 is being set with open permissions: ugo+rw Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:06 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 Apr 09 17:38:06 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:06 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1" returned: 0 in 0.478s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0544af23-29e0-406c-9592-401252a5aba1" released by "_copy_volume_from_snapshot" :: held 4.750s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-bb5bff08-a655-4bb2-bde1-c1560047deda-0544af23-29e0-406c-9592-401252a5aba1" released by "_create_volume_from_snapshot" :: held 4.775s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.789s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a72c20b-2392-4e21-b5a7-68f32a1602f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0544af23-29e0-406c-9592-401252a5aba1', 'volume_size': 1, 'snapshot_id': 'bb5bff08-a655-4bb2-bde1-c1560047deda'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c264eaf-896d-4294-8229-32f78bbefd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:06 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Volume volume-0544af23-29e0-406c-9592-401252a5aba1 (0544af23-29e0-406c-9592-401252a5aba1): created successfully Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c264eaf-896d-4294-8229-32f78bbefd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (de042c03-7a43-46ed-984e-775e5ab312bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:06 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=227,cinder:INSERT=78,cinder:UPDATE=313,cinder:DELETE=22 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:38:06 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-011a81f4-4d0f-4f11-bafc-b6d1fff0b78a tempest-VolumeDependencyTests-1757775827 None] Created volume successfully. Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-bb5bff08-a655-4bb2-bde1-c1560047deda-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-bb5bff08-a655-4bb2-bde1-c1560047deda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-943f18ca-0434-40ed-8282-15dfd96dfc0d" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-943f18ca-0434-40ed-8282-15dfd96dfc0d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-bb5bff08-a655-4bb2-bde1-c1560047deda" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-bb5bff08-a655-4bb2-bde1-c1560047deda" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Deleting offline snapshot bb5bff08-a655-4bb2-bde1-c1560047deda of volume 943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] snapshot_file for this snap is: volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[21519c27-82c8-45ac-80aa-570c3dbcdaa5]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:07 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda Apr 09 17:38:07 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:07 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda" returned: 0 in 0.528s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943f18ca-0434-40ed-8282-15dfd96dfc0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3442a398-954c-4061-b532-cab9d6d8f654]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:07 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Flow 'volume_create_manager' (90637c28-15be-4b5b-b751-f82c773895c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92ccb3c-d3f7-431b-b259-31d395d68815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:08 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:38:08 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92ccb3c-d3f7-431b-b259-31d395d68815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1218207391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3babbe6d-c989-4b2f-b2a4-2b2cd147a311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4e209deed34f30a44acd5d27293b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:08Z,use_quota=True,user_id='650e9b151faf4aa2a44048883cab017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8a3444-b4ea-4f53-bdb1-23425cc7be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8a3444-b4ea-4f53-bdb1-23425cc7be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4437bb-280a-439f-87e0-27302cd55be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4437bb-280a-439f-87e0-27302cd55be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3babbe6d-c989-4b2f-b2a4-2b2cd147a311', 'volume_name': 'volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cca1449-416f-493e-8f59-3585198f53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cca1449-416f-493e-8f59-3585198f53bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040e3d5c-9675-4e6c-8928-80c65c262f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:08 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Volume 3babbe6d-c989-4b2f-b2a4-2b2cd147a311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311', 'volume_size': 1} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1218207391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3babbe6d-c989-4b2f-b2a4-2b2cd147a311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4e209deed34f30a44acd5d27293b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:08Z,use_quota=True,user_id='650e9b151faf4aa2a44048883cab017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Creating volume 3babbe6d-c989-4b2f-b2a4-2b2cd147a311 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:08 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:08 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 1073741824 Apr 09 17:38:08 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:08 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:08 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:08 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.488s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:08 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda Apr 09 17:38:08 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:08 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 1073741824" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:08 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 Apr 09 17:38:08 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:08 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.460s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:08 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:08 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda Apr 09 17:38:08 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:09 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040e3d5c-9675-4e6c-8928-80c65c262f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dcfee9-dcb5-4f08-9bff-e3c514c78acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:09 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Volume volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 (3babbe6d-c989-4b2f-b2a4-2b2cd147a311): created successfully Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dcfee9-dcb5-4f08-9bff-e3c514c78acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Flow 'volume_create_manager' (90637c28-15be-4b5b-b751-f82c773895c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:09 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2ac87316-ed09-4943-a523-d97cd6c05a5e tempest-AbsoluteLimitsTests-1304378968 None] Created volume successfully. Apr 09 17:38:09 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d.bb5bff08-a655-4bb2-bde1-c1560047deda" returned: 0 in 0.411s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-bb5bff08-a655-4bb2-bde1-c1560047deda" released by "_delete_snapshot" :: held 1.960s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-943f18ca-0434-40ed-8282-15dfd96dfc0d" released by "delete_snapshot" :: held 1.971s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Created reservations ['b58a409b-c2cb-4d36-87ba-0a4c91abb1df', '7d92bd86-edc2-4f87-910c-c9efdda6fbad', '1437c778-a727-4102-b01d-3c627a7ab756', '554cf5e8-dafb-4083-95ff-edee6766e3c9'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:09 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Delete snapshot completed successfully. Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-6aef5243-be85-465c-ba57-25ebf0831939 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-bb5bff08-a655-4bb2-bde1-c1560047deda-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-943f18ca-0434-40ed-8282-15dfd96dfc0d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-943f18ca-0434-40ed-8282-15dfd96dfc0d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-943f18ca-0434-40ed-8282-15dfd96dfc0d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-943f18ca-0434-40ed-8282-15dfd96dfc0d" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9214a7e-186f-47b9-83d2-404ab95a105e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:09 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:38:09 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:10 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:10 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d Apr 09 17:38:10 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Acquiring lock "cinder-3babbe6d-c989-4b2f-b2a4-2b2cd147a311-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Lock "cinder-3babbe6d-c989-4b2f-b2a4-2b2cd147a311-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Acquiring lock "cinder-quobyte-3babbe6d-c989-4b2f-b2a4-2b2cd147a311" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Lock "cinder-quobyte-3babbe6d-c989-4b2f-b2a4-2b2cd147a311" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c586bc-e52e-4017-9fc4-a6fdf4d671a7]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:10 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 Apr 09 17:38:10 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:10 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-943f18ca-0434-40ed-8282-15dfd96dfc0d" returned: 0 in 0.447s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-943f18ca-0434-40ed-8282-15dfd96dfc0d" released by "delete_volume" :: held 0.958s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Created reservations ['85b04f42-0d5b-4438-99c5-d64f3f063f0f', 'e000ea01-fd56-4524-b41a-a993365c6c16', '2bf3a3d8-e3d0-404f-930f-1365f1ea597b', '256f8f8c-2802-4809-9b9a-8dba467068c2'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:10 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:10 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:10 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311" returned: 0 in 0.523s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:10 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311 Apr 09 17:38:10 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (db991e55-a61e-4e87-910d-693c051b4666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d28385b-0acf-4a3f-87b2-9ddc4115f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d28385b-0acf-4a3f-87b2-9ddc4115f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1820349982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b564315-5255-4bb7-a79c-342e49c2abf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5672afc795e4b3f9aec98f5ab0d42e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:11Z,use_quota=True,user_id='84f553bbe5c749af969e7649b59f742f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a1a9df-9209-475d-aad0-a9048c9309ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a1a9df-9209-475d-aad0-a9048c9309ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8f4ff3-d896-4963-9e65-5ed04cff0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8f4ff3-d896-4963-9e65-5ed04cff0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b564315-5255-4bb7-a79c-342e49c2abf9', 'volume_name': 'volume-9b564315-5255-4bb7-a79c-342e49c2abf9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c28ae-6e2b-496e-af54-fce00969239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c28ae-6e2b-496e-af54-fce00969239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b969b5-49d8-45ce-b829-6c0743ce8960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:10 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Volume 9b564315-5255-4bb7-a79c-342e49c2abf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b564315-5255-4bb7-a79c-342e49c2abf9', 'volume_size': 1} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1820349982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b564315-5255-4bb7-a79c-342e49c2abf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5672afc795e4b3f9aec98f5ab0d42e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:11Z,use_quota=True,user_id='84f553bbe5c749af969e7649b59f742f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Creating volume 9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:10 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:38:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:10 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 1073741824 Apr 09 17:38:10 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:11 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.456s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Deleted volume successfully. Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7d06ba5d-f03e-416e-a98f-d3b9594e87aa tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-943f18ca-0434-40ed-8282-15dfd96dfc0d-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:11 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3babbe6d-c989-4b2f-b2a4-2b2cd147a311" returned: 0 in 0.420s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Lock "cinder-quobyte-3babbe6d-c989-4b2f-b2a4-2b2cd147a311" released by "delete_volume" :: held 0.967s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Created reservations ['6d1653f0-56b8-4d2d-9ea5-edf17f2b00df', 'fdba8a77-4f81-4843-a4d8-a9ed492917e3', '15201d06-5dc3-4dcc-82b9-5fcf429d4898', 'f07042d5-c420-4684-af29-35effa79b20d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:11 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:11 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:11 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 1073741824" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:11 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:11 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:11 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.417s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Deleted volume successfully. Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-de689742-2c4c-4c6a-ac11-6ad36ca0d772 tempest-AbsoluteLimitsTests-1304378968 None] Lock "cinder-3babbe6d-c989-4b2f-b2a4-2b2cd147a311-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:11 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b969b5-49d8-45ce-b829-6c0743ce8960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b564315-5255-4bb7-a79c-342e49c2abf9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518c26e-3e2b-40c2-9de8-6140bf1348a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:11 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Volume volume-9b564315-5255-4bb7-a79c-342e49c2abf9 (9b564315-5255-4bb7-a79c-342e49c2abf9): created successfully Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518c26e-3e2b-40c2-9de8-6140bf1348a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:11 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (db991e55-a61e-4e87-910d-693c051b4666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e3e07d9a-2305-4887-8fc7-a5c66f7ce480 tempest-VolumeDependencyTests-1757775827 None] Created volume successfully. Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (e99d884b-7abf-48e6-b947-3aa249d2988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e673bf-f65f-4e7c-a180-8f812357279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e673bf-f65f-4e7c-a180-8f812357279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-656236033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0816dd5b-7688-4bd2-bddf-58499514a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5672afc795e4b3f9aec98f5ab0d42e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9b564315-5255-4bb7-a79c-342e49c2abf9,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:13Z,use_quota=True,user_id='84f553bbe5c749af969e7649b59f742f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eaaf3d-534e-41e0-96c1-31e6943ede4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eaaf3d-534e-41e0-96c1-31e6943ede4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cebffe-860b-48c7-8b27-00052a90fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cebffe-860b-48c7-8b27-00052a90fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0816dd5b-7688-4bd2-bddf-58499514a83e', 'volume_name': 'volume-0816dd5b-7688-4bd2-bddf-58499514a83e', 'volume_size': 1, 'source_volid': '9b564315-5255-4bb7-a79c-342e49c2abf9', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48e7f49-6f0b-4989-ac7e-ea6f96697f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48e7f49-6f0b-4989-ac7e-ea6f96697f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a9da73-6327-4efd-adf4-b7d3c7b58251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:13 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Volume 0816dd5b-7688-4bd2-bddf-58499514a83e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0816dd5b-7688-4bd2-bddf-58499514a83e', 'volume_size': 1, 'source_volid': '9b564315-5255-4bb7-a79c-342e49c2abf9', 'source_volstatus': 'available'} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:13 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Cloning volume 9b564315-5255-4bb7-a79c-342e49c2abf9 to volume 0816dd5b-7688-4bd2-bddf-58499514a83e Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Creating offline snapshot 989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 of volume 9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb6139d-22f7-43e9-9636-3c90c898ddbe]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:13 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:13 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:13 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.557s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:13 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 1G Apr 09 17:38:13 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:14 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 1G" returned: 0 in 0.549s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b564315-5255-4bb7-a79c-342e49c2abf9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:14 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b564315-5255-4bb7-a79c-342e49c2abf9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 Apr 09 17:38:14 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Flow 'volume_create_manager' (f5fbb33b-3902-41e8-8f3f-1ca0806d6f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934cc291-938b-4a26-bb0c-c448548f13c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934cc291-938b-4a26-bb0c-c448548f13c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-820385436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf60f4f-5420-4d07-aab4-0bf7072783e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71dd033073c41bbbbf89489532acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:15Z,use_quota=True,user_id='44de61e6dab14878b8b60cf7264bd3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ca4f3e-c4da-4cf1-ba80-34bf03187024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ca4f3e-c4da-4cf1-ba80-34bf03187024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51522575-30b3-4c05-b73d-df5849f3e2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51522575-30b3-4c05-b73d-df5849f3e2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf60f4f-5420-4d07-aab4-0bf7072783e1', 'volume_name': 'volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57449972-7412-4046-8aa9-d777bcc1989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57449972-7412-4046-8aa9-d777bcc1989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa66919c-79ee-41e1-a9e3-5c09783c23e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:14 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Volume fdf60f4f-5420-4d07-aab4-0bf7072783e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1', 'volume_size': 1} Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:14 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b564315-5255-4bb7-a79c-342e49c2abf9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" returned: 0 in 0.453s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:14 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 is being set with open permissions: ugo+rw Apr 09 17:38:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:14 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 Apr 09 17:38:14 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:15 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" returned: 0 in 0.408s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:15 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info Apr 09 17:38:15 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:15 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info" returned: 0 in 0.420s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:15 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info is being set with open permissions: ugo+rw Apr 09 17:38:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:15 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info Apr 09 17:38:15 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:16 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.info" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-0816dd5b-7688-4bd2-bddf-58499514a83e" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0816dd5b-7688-4bd2-bddf-58499514a83e" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] snapshot: 989a37bd-7ca3-475b-b5c6-bc8ec7d455c8, volume: 0816dd5b-7688-4bd2-bddf-58499514a83e, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f063293-a517-447e-8fcf-1c8d262ea700]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:16 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 Apr 09 17:38:16 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:16 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b564315-5255-4bb7-a79c-342e49c2abf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfaa6ca-96da-4ef8-ab11-89e021aff24d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:16 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:16 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:17 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:17 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:38:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:17 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e Apr 09 17:38:17 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:19 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e" returned: 0 in 1.965s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f65aaf-e97c-4f9b-aa23-e8624015a311]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:19 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:19 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:19 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.597s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:19 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:38:19 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Converted 1024.00 MB image at 520.88 MB/s Apr 09 17:38:19 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e is being set with open permissions: ugo+rw Apr 09 17:38:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:19 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e Apr 09 17:38:19 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:20 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e" returned: 0 in 0.422s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0816dd5b-7688-4bd2-bddf-58499514a83e" released by "_copy_volume_from_snapshot" :: held 3.962s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Deleting offline snapshot 989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 of volume 9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] snapshot_file for this snap is: volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6010086-711a-41b0-870c-d8548d90a4c3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:20 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 Apr 09 17:38:20 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:20 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b564315-5255-4bb7-a79c-342e49c2abf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[10310990-3030-48b8-b0e2-a61cbf0d8ec1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:20 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:20 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:21 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:21 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 Apr 09 17:38:21 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:21 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:21 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8 Apr 09 17:38:21 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:22 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9.989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" returned: 0 in 0.416s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-989a37bd-7ca3-475b-b5c6-bc8ec7d455c8" released by "_delete_snapshot" :: held 1.850s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.718s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.212s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-820385436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf60f4f-5420-4d07-aab4-0bf7072783e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71dd033073c41bbbbf89489532acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:15Z,use_quota=True,user_id='44de61e6dab14878b8b60cf7264bd3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Creating volume fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:22 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a9da73-6327-4efd-adf4-b7d3c7b58251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0816dd5b-7688-4bd2-bddf-58499514a83e', 'volume_size': 1, 'source_volid': '9b564315-5255-4bb7-a79c-342e49c2abf9', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:22 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 1073741824 Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952317af-4eeb-45c5-9467-a6af1285be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:22 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:22 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Volume volume-0816dd5b-7688-4bd2-bddf-58499514a83e (0816dd5b-7688-4bd2-bddf-58499514a83e): created successfully Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952317af-4eeb-45c5-9467-a6af1285be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Flow 'volume_create_manager' (e99d884b-7abf-48e6-b947-3aa249d2988f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:22 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a6657767-4d17-4085-bb15-f5740733b1c4 tempest-VolumeDependencyTests-1757775827 None] Created volume successfully. Apr 09 17:38:22 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 1073741824" returned: 0 in 0.497s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:22 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:22 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-9b564315-5255-4bb7-a79c-342e49c2abf9-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-9b564315-5255-4bb7-a79c-342e49c2abf9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-9b564315-5255-4bb7-a79c-342e49c2abf9" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-9b564315-5255-4bb7-a79c-342e49c2abf9" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c0981-a778-46c9-b525-3912a3c25df6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:22 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:22 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:23 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.443s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa66919c-79ee-41e1-a9e3-5c09783c23e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91f8468-d731-4bf0-acce-a5b0c9062b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:23 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Volume volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 (fdf60f4f-5420-4d07-aab4-0bf7072783e1): created successfully Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91f8468-d731-4bf0-acce-a5b0c9062b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Flow 'volume_create_manager' (f5fbb33b-3902-41e8-8f3f-1ca0806d6f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ce5e76c8-a70e-4612-b485-991077c554de tempest-VolumesDeleteCascade-1737493966 None] Created volume successfully. Apr 09 17:38:23 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:23 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9 Apr 09 17:38:23 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Creating offline snapshot 0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 of volume fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[182a4765-d86e-4b03-a65f-a694b8d92469]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:23 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:23 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:23 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-9b564315-5255-4bb7-a79c-342e49c2abf9" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-9b564315-5255-4bb7-a79c-342e49c2abf9" released by "delete_volume" :: held 0.976s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Created reservations ['3d9bc230-fea7-4acd-b40f-49f2a3046212', '0c5c8e92-ac51-47e7-b902-baadd5972f7a', '11f13434-6f99-4fc0-b265-ed5244a26db9', '0be6760e-7f76-4786-87cf-5aac9a107a66'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:23 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:23 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:23 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.497s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:23 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 1G Apr 09 17:38:23 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:24 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:24 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Deleted volume successfully. Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-503af45b-7294-443a-a00b-f3c18d75f4f4 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-9b564315-5255-4bb7-a79c-342e49c2abf9-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:24 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 1G" returned: 0 in 0.485s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:24 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:24 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:24 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.429s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:24 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 is being set with open permissions: ugo+rw Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:24 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:24 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-0816dd5b-7688-4bd2-bddf-58499514a83e-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-0816dd5b-7688-4bd2-bddf-58499514a83e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-0816dd5b-7688-4bd2-bddf-58499514a83e" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0816dd5b-7688-4bd2-bddf-58499514a83e" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d088162-5255-4195-8aa4-0e04577e976e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:25 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e Apr 09 17:38:25 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:25 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.423s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:25 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info Apr 09 17:38:25 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:25 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e" returned: 0 in 0.486s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:25 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e Apr 09 17:38:25 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:25 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:25 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info is being set with open permissions: ugo+rw Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:25 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info Apr 09 17:38:25 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:25 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0816dd5b-7688-4bd2-bddf-58499514a83e" returned: 0 in 0.398s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0816dd5b-7688-4bd2-bddf-58499514a83e" released by "delete_volume" :: held 0.907s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Created reservations ['1fd1bbc0-90f0-4108-b7f4-f87634563a3a', '65fc1d7e-c9ff-4cb3-93c0-8649a9b9f757', '05a7aaf8-73c9-4a4f-8b0b-0ba04270d9f7', 'e71982d7-4188-4e6e-bb1a-e83327e450dd'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:26 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:26 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-0544af23-29e0-406c-9592-401252a5aba1-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-0544af23-29e0-406c-9592-401252a5aba1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:26 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.info" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "cinder-quobyte-0544af23-29e0-406c-9592-401252a5aba1" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-94979a0f-2516-4b15-a150-8ba58edb67c0 tempest-VolumesDeleteCascade-1737493966 None] Create snapshot completed successfully Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0544af23-29e0-406c-9592-401252a5aba1" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fcdc1e-885e-4c1d-8b92-168c0b5ee805]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:26 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 Apr 09 17:38:26 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:26 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.460s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Deleted volume successfully. Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-69353aaf-e52d-4030-892f-448be8588094 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-0816dd5b-7688-4bd2-bddf-58499514a83e-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Creating offline snapshot 406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 of volume fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc89de6-e2a0-45b8-bdcd-4882d82aac58]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:26 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:26 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1 Apr 09 17:38:26 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:26 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:26 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:27 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0544af23-29e0-406c-9592-401252a5aba1" returned: 0 in 0.409s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-quobyte-0544af23-29e0-406c-9592-401252a5aba1" released by "delete_volume" :: held 0.943s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:27 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.460s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:27 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 1G Apr 09 17:38:27 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Created reservations ['19a054b1-ba6f-41d5-acc3-4588a86dbb45', 'd9911298-f7df-4ed2-82a5-5d41ce4df35a', '798dcdda-9e88-4d33-b2a0-1527639a481d', 'd5d0c86a-cabb-4a82-8e75-ca6351dd961a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:27 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:27 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:27 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 1G" returned: 0 in 0.501s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:27 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 Apr 09 17:38:27 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:27 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.565s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:27 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Deleted volume successfully. Apr 09 17:38:27 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-32df5e63-288f-44bb-a991-c4d956fe24e7 tempest-VolumeDependencyTests-1757775827 None] Lock "cinder-0544af23-29e0-406c-9592-401252a5aba1-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:28 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:28 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 is being set with open permissions: ugo+rw Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:28 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 Apr 09 17:38:28 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:28 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" returned: 0 in 0.434s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:28 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4a5101eb-e821-4368-b270-e243fca49ca4 tempest-VolumesDeleteCascade-1737493966 None] Create snapshot completed successfully Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-fdf60f4f-5420-4d07-aab4-0bf7072783e1-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-fdf60f4f-5420-4d07-aab4-0bf7072783e1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Performing cascade delete. {{(pid=82701) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Deleting offline snapshot 0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 of volume fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] snapshot_file for this snap is: volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab70e5-13b2-471a-b102-cacccf7cb8e8]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:28 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:28 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:29 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.467s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e3a2e-01b6-4424-bbc4-51b0d5ab1af4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:29 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:29 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:29 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.466s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3178add-a27a-4cbb-bee0-88e80415569a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:29 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 Apr 09 17:38:29 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:30 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b393d46b-b467-4f00-920a-aaba5231e26e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:30 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:30 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:30 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.456s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced3f6b-4f7b-44f3-ad26-84780fa60413]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:30 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:30 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:31 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.456s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:31 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:31 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:31 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.437s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:31 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8 Apr 09 17:38:31 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:32 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 -F qcow2 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:32 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 -F qcow2 Apr 09 17:38:32 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:32 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 -F qcow2" returned: 0 in 0.425s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8" released by "_delete_snapshot" :: held 3.681s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" released by "delete_snapshot" :: held 3.692s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Created reservations ['0bcd63e8-18bb-4fc1-a840-ac3c0ae754ce', '26eb9b47-eb59-4df2-b801-2bd0a2510bf4', '17c6b6b4-0628-4d2b-8305-0e789f2e2868', '7ae63e22-09da-4ef6-84a8-1eabd3a2739c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:32 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Delete snapshot completed successfully. Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-0fdabeb6-5d7d-48f2-8d48-c22b6a2a78d8-delete_snapshot" released by "delete_snapshot" :: held 3.791s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Deleting offline snapshot 406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 of volume fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] snapshot_file for this snap is: volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9470b0-d1e6-4a6e-a53e-3f5919620000]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:32 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 Apr 09 17:38:32 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:33 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b962689-c6f0-49c8-8e6d-c484dc36e923]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:33 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:33 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:33 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.468s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:33 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 Apr 09 17:38:33 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:34 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" returned: 0 in 0.438s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:34 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8 Apr 09 17:38:34 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:34 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1.406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" returned: 0 in 0.420s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8" released by "_delete_snapshot" :: held 1.848s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" released by "delete_snapshot" :: held 1.858s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Created reservations ['77654803-756c-4a51-aa44-abfcde9dca4a', 'e4b37d62-ccd0-4509-b2dd-d1518373d4d1', '09bfdd1b-b07d-400d-966b-ad117c0bc8d2', '41b4a826-8663-43ab-bd72-9ead49276e4b'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:34 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Delete snapshot completed successfully. Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-406d4d9f-8d2d-48e7-ab3b-3e258fa26cb8-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Snapshots deleted, issuing volume delete {{(pid=82701) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5453147-f4d7-4df0-8b05-4b17e665d980]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:34 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:34 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:35 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:35 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1 Apr 09 17:38:35 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:35 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-fdf60f4f-5420-4d07-aab4-0bf7072783e1" returned: 0 in 0.423s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-fdf60f4f-5420-4d07-aab4-0bf7072783e1" released by "delete_volume" :: held 0.912s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Created reservations ['cc27efbb-2788-44d0-b604-15d68acfac5a', '542089cd-2055-46fc-8718-0021cac9ff77', '17a8e81c-4032-42da-8fbc-1a4e6a7a4aa2', '665be1d9-0705-4a0a-949a-1a67edda1567'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:35 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:35 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:35 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.416s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:35 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Deleted volume successfully. Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-af658bea-183c-4b80-962c-7e5261d38dfa tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-fdf60f4f-5420-4d07-aab4-0bf7072783e1-delete_volume" released by "delete_volume" :: held 7.227s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Flow 'volume_create_manager' (c51c9de5-7062-4ee2-a418-11cddbbc6fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7cdf415-2149-4317-8ba5-9d1439a4bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7cdf415-2149-4317-8ba5-9d1439a4bff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1961777494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e801a7ba-d67d-44c3-9683-4997538a5ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71dd033073c41bbbbf89489532acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:36Z,use_quota=True,user_id='44de61e6dab14878b8b60cf7264bd3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8cd1ac-ab35-4929-a3b2-90c92e03e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8cd1ac-ab35-4929-a3b2-90c92e03e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17953ba3-9bf1-4082-b5c4-2a8d3a8efed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17953ba3-9bf1-4082-b5c4-2a8d3a8efed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e801a7ba-d67d-44c3-9683-4997538a5ded', 'volume_name': 'volume-e801a7ba-d67d-44c3-9683-4997538a5ded', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a493becf-7a46-4ca7-aae9-73ef790720f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a493becf-7a46-4ca7-aae9-73ef790720f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddf99fd-1b72-4feb-8cd2-a31d389d493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:36 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Volume e801a7ba-d67d-44c3-9683-4997538a5ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e801a7ba-d67d-44c3-9683-4997538a5ded', 'volume_size': 1} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1961777494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e801a7ba-d67d-44c3-9683-4997538a5ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71dd033073c41bbbbf89489532acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:36Z,use_quota=True,user_id='44de61e6dab14878b8b60cf7264bd3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Creating volume e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:36 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:38:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:36 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded 1073741824 Apr 09 17:38:36 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:37 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded 1073741824" returned: 0 in 0.484s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:37 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:37 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:37 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.395s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddf99fd-1b72-4feb-8cd2-a31d389d493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e801a7ba-d67d-44c3-9683-4997538a5ded', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30f1f97-664a-4ac0-9ec8-ec7978720971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:37 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Volume volume-e801a7ba-d67d-44c3-9683-4997538a5ded (e801a7ba-d67d-44c3-9683-4997538a5ded): created successfully Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30f1f97-664a-4ac0-9ec8-ec7978720971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Flow 'volume_create_manager' (c51c9de5-7062-4ee2-a418-11cddbbc6fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:37 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b42ff1d5-0c05-4090-86e8-6476c017a68d tempest-VolumesDeleteCascade-1737493966 None] Created volume successfully. Apr 09 17:38:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Creating offline snapshot 69123209-38e0-4939-8249-0dd4eef478ee of volume e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:38:38 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[48632398-c41d-47f9-8672-b0aa25a7cd74]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:38 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:38 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:39 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:39 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee 1G Apr 09 17:38:39 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:39 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee 1G" returned: 0 in 0.457s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e801a7ba-d67d-44c3-9683-4997538a5ded -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:39 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e801a7ba-d67d-44c3-9683-4997538a5ded -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee Apr 09 17:38:39 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:40 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e801a7ba-d67d-44c3-9683-4997538a5ded -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee" returned: 0 in 0.425s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:40 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee is being set with open permissions: ugo+rw Apr 09 17:38:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:40 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee Apr 09 17:38:40 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:40 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee" returned: 0 in 0.403s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:40 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info Apr 09 17:38:40 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:40 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info" returned: 0 in 0.427s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:40 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info is being set with open permissions: ugo+rw Apr 09 17:38:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:40 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info Apr 09 17:38:40 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:41 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.info" returned: 0 in 0.395s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:41 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:UPDATE=254,cinder:DELETE=27,cinder:SELECT=201,cinder:INSERT=57 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:38:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3f413931-b4be-4d14-9cba-b3c5d41caaf8 tempest-VolumesDeleteCascade-1737493966 None] Create snapshot completed successfully Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Flow 'volume_create_manager' (db3a46d5-146f-4d6f-9f6a-09fab73759ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e30e25-88ed-484c-b11b-e0881c5ffafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e30e25-88ed-484c-b11b-e0881c5ffafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1845497923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71dd033073c41bbbbf89489532acf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69123209-38e0-4939-8249-0dd4eef478ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:42Z,use_quota=True,user_id='44de61e6dab14878b8b60cf7264bd3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a00c8f-e98b-45b9-a27c-89f3d7163501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a00c8f-e98b-45b9-a27c-89f3d7163501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792d636f-bcf9-43c1-92ec-125713c5e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792d636f-bcf9-43c1-92ec-125713c5e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99', 'volume_name': 'volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99', 'volume_size': 1, 'snapshot_id': '69123209-38e0-4939-8249-0dd4eef478ee'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4f7e65-5b60-406b-a4dd-8febebb007da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4f7e65-5b60-406b-a4dd-8febebb007da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a623bd68-0aab-4856-b58e-170d493c0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:42 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Volume db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99', 'volume_size': 1, 'snapshot_id': '69123209-38e0-4939-8249-0dd4eef478ee'} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-69123209-38e0-4939-8249-0dd4eef478ee-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-69123209-38e0-4939-8249-0dd4eef478ee-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Creating volume db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 from snapshot 69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] snapshot: 69123209-38e0-4939-8249-0dd4eef478ee, volume: db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc61532d-d84a-40c0-9e69-3169ddddcdc4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:42 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee Apr 09 17:38:42 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:42 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e801a7ba-d67d-44c3-9683-4997538a5ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b64454-5544-48b4-ac7f-99033de7f2d3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:42 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:42 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:43 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:43 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:38:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:43 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 Apr 09 17:38:43 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:45 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" returned: 0 in 1.918s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:45 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2747811-2ff5-4e4f-99dd-b67a6d87660a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:45 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:45 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:45 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.590s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:45 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:38:45 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Converted 1024.00 MB image at 533.44 MB/s Apr 09 17:38:45 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 is being set with open permissions: ugo+rw Apr 09 17:38:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:45 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 Apr 09 17:38:45 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:46 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" released by "_copy_volume_from_snapshot" :: held 3.920s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-69123209-38e0-4939-8249-0dd4eef478ee-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" released by "_create_volume_from_snapshot" :: held 3.935s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.947s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a623bd68-0aab-4856-b58e-170d493c0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99', 'volume_size': 1, 'snapshot_id': '69123209-38e0-4939-8249-0dd4eef478ee'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bcf59f-85d2-44d7-82e9-d2a1c392d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:46 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Volume volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 (db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99): created successfully Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bcf59f-85d2-44d7-82e9-d2a1c392d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Flow 'volume_create_manager' (db3a46d5-146f-4d6f-9f6a-09fab73759ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-07b9f3ed-421f-4f8e-b103-a25719f27f4c tempest-VolumesDeleteCascade-1737493966 None] Created volume successfully. Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-e801a7ba-d67d-44c3-9683-4997538a5ded-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-e801a7ba-d67d-44c3-9683-4997538a5ded-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Performing cascade delete. {{(pid=82701) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-69123209-38e0-4939-8249-0dd4eef478ee-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-69123209-38e0-4939-8249-0dd4eef478ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-e801a7ba-d67d-44c3-9683-4997538a5ded" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-e801a7ba-d67d-44c3-9683-4997538a5ded" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-69123209-38e0-4939-8249-0dd4eef478ee" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-69123209-38e0-4939-8249-0dd4eef478ee" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Deleting offline snapshot 69123209-38e0-4939-8249-0dd4eef478ee of volume e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] snapshot_file for this snap is: volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67d3ec-ca53-4721-9330-f03668307d16]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:46 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee Apr 09 17:38:46 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:46 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e801a7ba-d67d-44c3-9683-4997538a5ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dcaf71-b251-4a1f-b41e-092d0a50bbb7]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:46 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:46 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:47 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:47 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee Apr 09 17:38:47 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:47 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:47 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee Apr 09 17:38:47 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:48 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded.69123209-38e0-4939-8249-0dd4eef478ee" returned: 0 in 0.400s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-69123209-38e0-4939-8249-0dd4eef478ee" released by "_delete_snapshot" :: held 1.826s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-e801a7ba-d67d-44c3-9683-4997538a5ded" released by "delete_snapshot" :: held 1.837s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Created reservations ['0cd8671c-0a41-48c1-9931-a6eb83a7fa1d', '54203a9f-2f4c-4504-b6c3-dcbdd670dc0e', '95c72446-a876-464a-bdfb-8e00dbdea4de', '633dbb21-706f-4d5f-ab18-5aac9ed0bbc4'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Delete snapshot completed successfully. Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-69123209-38e0-4939-8249-0dd4eef478ee-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Snapshots deleted, issuing volume delete {{(pid=82701) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-e801a7ba-d67d-44c3-9683-4997538a5ded" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-e801a7ba-d67d-44c3-9683-4997538a5ded" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a26e31-9800-4e74-8783-c72f1bbba681]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:48 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:48 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:48 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.487s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:48 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded Apr 09 17:38:48 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:49 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e801a7ba-d67d-44c3-9683-4997538a5ded" returned: 0 in 0.400s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-e801a7ba-d67d-44c3-9683-4997538a5ded" released by "delete_volume" :: held 0.914s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Created reservations ['d87ff3dc-2f07-4abf-aafc-d5fb6edd7baf', '6742027f-06d5-4934-af66-0dd2948555f7', '44fad9ab-e74e-48f0-bc9f-e89b470fea97', '74d29b96-7da2-4493-81eb-b8b36df65db3'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:49 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:49 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "cinder-quobyte-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" acquired by "delete_volume" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff52ee-a53f-4ec6-a528-aa8dda4bb295]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:49 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Deleted volume successfully. Apr 09 17:38:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-082114b4-32c9-424c-8f3c-eb512a547147 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-e801a7ba-d67d-44c3-9683-4997538a5ded-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:49 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 Apr 09 17:38:49 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:50 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" returned: 0 in 0.475s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:50 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99 Apr 09 17:38:50 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:50 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" returned: 0 in 0.417s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-quobyte-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99" released by "delete_volume" :: held 0.915s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Created reservations ['7d9e32e9-4b2a-4667-84d6-d795f13ea27d', '8e3c04e5-d1d7-40f5-ac7c-813b585377b6', 'b2caa64a-75b7-4129-8dab-806d39a64132', '0427851c-d423-4a0d-9263-3e120519f791'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:50 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:50 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:51 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.463s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:51 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:51 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Deleted volume successfully. Apr 09 17:38:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-748f395c-3fb3-4e3d-82a2-5ccda78337a7 tempest-VolumesDeleteCascade-1737493966 None] Lock "cinder-db23dfa7-3a2a-4ff8-b2a4-6d0d3fa3af99-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Flow 'volume_create_manager' (7680001b-9719-43fe-bc15-d82b403ae173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a117e112-5dd4-4776-8c54-e4838d765769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a117e112-5dd4-4776-8c54-e4838d765769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1321396193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b54dfe-8c53-4b39-bb2e-375aa04a2def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14db7c6b4ec4c3da32b43e4581c5f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:53Z,use_quota=True,user_id='aee746e470d64f3abd191c9b9b8b5757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453c9758-de9e-4173-830a-c9efb65d2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453c9758-de9e-4173-830a-c9efb65d2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2795d7b-4b4e-4b8c-ba2b-dfbab77e1939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2795d7b-4b4e-4b8c-ba2b-dfbab77e1939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b54dfe-8c53-4b39-bb2e-375aa04a2def', 'volume_name': 'volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8d52d0-bd1d-46f6-a174-398ac9b36254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8d52d0-bd1d-46f6-a174-398ac9b36254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39b43d1-72e5-455d-9343-6c2f6fb45bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:53 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Volume b7b54dfe-8c53-4b39-bb2e-375aa04a2def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def', 'volume_size': 1} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1321396193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7b54dfe-8c53-4b39-bb2e-375aa04a2def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14db7c6b4ec4c3da32b43e4581c5f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:53Z,use_quota=True,user_id='aee746e470d64f3abd191c9b9b8b5757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Creating volume b7b54dfe-8c53-4b39-bb2e-375aa04a2def {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:53 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:53 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def 1073741824 Apr 09 17:38:53 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:53 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def 1073741824" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:53 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def Apr 09 17:38:53 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:54 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39b43d1-72e5-455d-9343-6c2f6fb45bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f93b9e-3dea-48dc-a6ce-72cb62641741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Volume volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def (b7b54dfe-8c53-4b39-bb2e-375aa04a2def): created successfully Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f93b9e-3dea-48dc-a6ce-72cb62641741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Flow 'volume_create_manager' (7680001b-9719-43fe-bc15-d82b403ae173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-690cac05-c741-49e6-9a27-3914064e1fa4 tempest-VolumesTransfersV355Test-1819913033 None] Created volume successfully. Apr 09 17:38:55 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-bf68065f-8cc9-4ecd-9f14-208c6be95fda tempest-VolumesTransfersV355Test-51642946 None] Transfer volume completed successfully. Apr 09 17:38:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Acquiring lock "cinder-b7b54dfe-8c53-4b39-bb2e-375aa04a2def-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-b7b54dfe-8c53-4b39-bb2e-375aa04a2def-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Acquiring lock "cinder-quobyte-b7b54dfe-8c53-4b39-bb2e-375aa04a2def" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-quobyte-b7b54dfe-8c53-4b39-bb2e-375aa04a2def" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:56 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6566232-9ba8-4f7a-b11e-b5ba81ea0158]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:56 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def Apr 09 17:38:56 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:57 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:57 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def Apr 09 17:38:57 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:57 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b7b54dfe-8c53-4b39-bb2e-375aa04a2def" returned: 0 in 0.412s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-quobyte-b7b54dfe-8c53-4b39-bb2e-375aa04a2def" released by "delete_volume" :: held 0.903s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Created reservations ['b2473593-08f0-4df4-b0f2-d7c0c54c7afc', 'd3d16699-2c47-46da-bf70-4c1ccda6104a', '3b14010d-2c41-4cdf-bcc4-6f1a10b041a8', '5bd20c20-083e-4b76-8cd7-9d4d6afeab61'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:57 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:38:57 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Flow 'volume_create_manager' (6c95d8e7-9248-4028-b627-7a73daf817f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696de7a7-7b7f-4590-af67-893f0ea1bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696de7a7-7b7f-4590-af67-893f0ea1bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1198536378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14db7c6b4ec4c3da32b43e4581c5f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:58Z,use_quota=True,user_id='aee746e470d64f3abd191c9b9b8b5757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9def68-7795-437c-b592-8aa64bd20f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9def68-7795-437c-b592-8aa64bd20f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeb7a55-d50a-4513-a675-582c0bbb0a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeb7a55-d50a-4513-a675-582c0bbb0a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff', 'volume_name': 'volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619958c6-0860-4f6d-bd25-db1284683882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619958c6-0860-4f6d-bd25-db1284683882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a65962-0f4f-4601-b58c-39427ca2f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:57 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Volume 0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff', 'volume_size': 1} Apr 09 17:38:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1198536378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14db7c6b4ec4c3da32b43e4581c5f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:38:58Z,use_quota=True,user_id='aee746e470d64f3abd191c9b9b8b5757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Creating volume 0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:38:58 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:58 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:38:58 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Deleted volume successfully. Apr 09 17:38:58 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff 1073741824 Apr 09 17:38:58 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3e978926-c55c-494f-950a-ab1eb0ff6e40 tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-b7b54dfe-8c53-4b39-bb2e-375aa04a2def-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:38:58 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff 1073741824" returned: 0 in 0.463s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:58 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff Apr 09 17:38:58 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:58 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff" returned: 0 in 0.407s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a65962-0f4f-4601-b58c-39427ca2f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdd88c6-5bd4-4b3e-a870-aa78607fbb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:38:58 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Volume volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff (0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff): created successfully Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdd88c6-5bd4-4b3e-a870-aa78607fbb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:38:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Flow 'volume_create_manager' (6c95d8e7-9248-4028-b627-7a73daf817f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:38:58 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f4967592-9de9-4724-bbf6-33b8b2e48db8 tempest-VolumesTransfersV355Test-1819913033 None] Created volume successfully. Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Acquiring lock "cinder-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Acquiring lock "cinder-quobyte-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-quobyte-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157dc7d-647c-4b0a-85c5-ff5627f7f3d3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:59 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff Apr 09 17:38:59 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:38:59 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff" returned: 0 in 0.476s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:38:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:38:59 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff Apr 09 17:38:59 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:00 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff" returned: 0 in 0.405s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-quobyte-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff" released by "delete_volume" :: held 0.904s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Created reservations ['a8379bd7-edf9-4880-b4d6-604a82bbc26c', '076a4f3b-0c6b-4c93-a88e-692078a387dc', '634367e1-4c81-4c42-b3a1-73b6509595bf', 'ba42410f-e872-46c7-9df9-2e99f1301f23'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:00 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:00 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:00 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.431s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Deleted volume successfully. Apr 09 17:39:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a10ac7fc-9ebe-4e1d-8337-7eae58ea947e tempest-VolumesTransfersV355Test-130933951 None] Lock "cinder-0f9c9f70-a6d2-40d4-bd85-ef469c7d07ff-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Flow 'volume_create_manager' (2bcf032e-6dee-4b61-a3a4-f81fd18a573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b1e426-c276-4b0c-a3ad-bf229ce0eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b1e426-c276-4b0c-a3ad-bf229ce0eded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1251096320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca2207-3ed4-4c98-91f6-a0edf2a377df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='355bd10662f54a6a95a5bb3d3b898fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:04Z,use_quota=True,user_id='daa39977f44d42c780d91905a3c94136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc7574b-1fef-4214-a712-042885de1c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc7574b-1fef-4214-a712-042885de1c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047b934f-41d1-4c6c-ad56-9aef9fa6eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047b934f-41d1-4c6c-ad56-9aef9fa6eae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aca2207-3ed4-4c98-91f6-a0edf2a377df', 'volume_name': 'volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dfccfb-74da-4975-886f-4984fbc36eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dfccfb-74da-4975-886f-4984fbc36eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b908193d-6c6a-43cc-9744-5419b0c86591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Volume 5aca2207-3ed4-4c98-91f6-a0edf2a377df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df', 'volume_size': 1} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1251096320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca2207-3ed4-4c98-91f6-a0edf2a377df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='355bd10662f54a6a95a5bb3d3b898fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:04Z,use_quota=True,user_id='daa39977f44d42c780d91905a3c94136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Creating volume 5aca2207-3ed4-4c98-91f6-a0edf2a377df {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:04 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:04 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df 1073741824 Apr 09 17:39:04 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:04 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df 1073741824" returned: 0 in 0.465s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:04 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df Apr 09 17:39:04 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:04 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df" returned: 0 in 0.412s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b908193d-6c6a-43cc-9744-5419b0c86591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db07a68-4f1b-4c4c-bf6c-f2dcd75cb9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Volume volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df (5aca2207-3ed4-4c98-91f6-a0edf2a377df): created successfully Apr 09 17:39:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db07a68-4f1b-4c4c-bf6c-f2dcd75cb9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Flow 'volume_create_manager' (2bcf032e-6dee-4b61-a3a4-f81fd18a573a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e3e9c300-a677-43bc-8f28-21fc7aedd23a tempest-VolumesTransfersV357Test-1165953326 None] Created volume successfully. Apr 09 17:39:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-11bc67a0-0a49-4ee4-a478-86a28309773e tempest-VolumesTransfersV357Test-886838384 None] Transfer volume completed successfully. Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Acquiring lock "cinder-5aca2207-3ed4-4c98-91f6-a0edf2a377df-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-5aca2207-3ed4-4c98-91f6-a0edf2a377df-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Acquiring lock "cinder-quobyte-5aca2207-3ed4-4c98-91f6-a0edf2a377df" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-quobyte-5aca2207-3ed4-4c98-91f6-a0edf2a377df" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa3dfb4-4be9-48b8-a24f-711a97d1884f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:06 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df Apr 09 17:39:06 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:06 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df" returned: 0 in 0.460s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:06 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df Apr 09 17:39:06 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:07 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5aca2207-3ed4-4c98-91f6-a0edf2a377df" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-quobyte-5aca2207-3ed4-4c98-91f6-a0edf2a377df" released by "delete_volume" :: held 0.902s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=115,cinder:UPDATE=132,cinder:DELETE=10,cinder:INSERT=40 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Created reservations ['7c6baf7f-a48b-46b8-a85b-5d6a34811825', '42ee8701-0f3c-4af7-b379-ede1ca0bf01d', 'c17b1fe6-4503-4dc5-ac6b-4f5670ac33a0', '5907f613-d5d9-4745-8a9e-ab19107e251f'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:07 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:07 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Flow 'volume_create_manager' (d3b91ad2-cd77-484e-9293-b1e7eeb6c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067993d4-64dd-4900-9cc3-094dc2600703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067993d4-64dd-4900-9cc3-094dc2600703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-632029766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='355bd10662f54a6a95a5bb3d3b898fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:08Z,use_quota=True,user_id='daa39977f44d42c780d91905a3c94136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0446e8d2-fdb5-47d5-89f9-7694fca4da19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0446e8d2-fdb5-47d5-89f9-7694fca4da19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fd8775-d5a0-4192-a7f8-b7d0a54d804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fd8775-d5a0-4192-a7f8-b7d0a54d804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd', 'volume_name': 'volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cced419-92eb-4b57-9f6c-5e42d7b41ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cced419-92eb-4b57-9f6c-5e42d7b41ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5e8e8a-eb0b-41b5-a603-fcb6c276b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:07 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Volume bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd', 'volume_size': 1} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-632029766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='355bd10662f54a6a95a5bb3d3b898fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:08Z,use_quota=True,user_id='daa39977f44d42c780d91905a3c94136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Creating volume bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:07 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:07 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd 1073741824 Apr 09 17:39:07 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:07 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.447s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:07 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Deleted volume successfully. Apr 09 17:39:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f152bcb4-682f-40a3-8b58-46e7c00d6fe4 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-5aca2207-3ed4-4c98-91f6-a0edf2a377df-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:08 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd 1073741824" returned: 0 in 0.485s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:08 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd Apr 09 17:39:08 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:08 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:08 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:08 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5e8e8a-eb0b-41b5-a603-fcb6c276b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47754ef0-b4bc-44a0-bb0f-c31352c5c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:08 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Volume volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd (bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd): created successfully Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47754ef0-b4bc-44a0-bb0f-c31352c5c23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Flow 'volume_create_manager' (d3b91ad2-cd77-484e-9293-b1e7eeb6c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:08 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3e6dd1eb-2294-433f-8449-850405e9a647 tempest-VolumesTransfersV357Test-1165953326 None] Created volume successfully. Apr 09 17:39:08 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.424s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Acquiring lock "cinder-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Acquiring lock "cinder-quobyte-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-quobyte-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:09 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe0483f-0d12-4d4c-b1cf-61ff6df7d515]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:09 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd Apr 09 17:39:09 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:10 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:10 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd Apr 09 17:39:10 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:10 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-quobyte-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd" released by "delete_volume" :: held 0.918s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Created reservations ['678256c2-45b6-412e-8cea-a27e66c24ea7', 'bda9b26c-8878-4e51-ad2b-950747a287b1', 'fc245e00-69d7-4ffc-a83a-bb418d1f0978', 'f9111310-a728-4407-bb76-8916054783ff'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:10 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:10 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:11 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.437s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:11 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:11 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Deleted volume successfully. Apr 09 17:39:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-9802aa27-348e-4724-b413-c86155c2ccf0 tempest-VolumesTransfersV357Test-1668952031 None] Lock "cinder-bd23cbb7-d2d3-4a2b-b5eb-4ebdaa56adbd-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Flow 'volume_create_manager' (6627ac76-f08a-49ac-b28c-189eb345e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9c7ec9-55f4-49ff-b79a-c38d89cdf34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9c7ec9-55f4-49ff-b79a-c38d89cdf34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-125118381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715e58d1-f675-4704-a4df-400606ee492d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ad476d2ffa4c66ae81fb08edd7dde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:14Z,use_quota=True,user_id='4209e723624f418eb10b3456874955ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cd9730-6f57-4891-8921-2255e798706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cd9730-6f57-4891-8921-2255e798706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eec49b-3a68-423a-a91e-126b82b5f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eec49b-3a68-423a-a91e-126b82b5f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715e58d1-f675-4704-a4df-400606ee492d', 'volume_name': 'volume-715e58d1-f675-4704-a4df-400606ee492d', 'volume_size': 2}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4835d5d-4cc4-4c0b-9337-45035b83f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4835d5d-4cc4-4c0b-9337-45035b83f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf903f3-965e-448e-98f2-340e28af76c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:14 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Volume 715e58d1-f675-4704-a4df-400606ee492d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715e58d1-f675-4704-a4df-400606ee492d', 'volume_size': 2} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-125118381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715e58d1-f675-4704-a4df-400606ee492d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ad476d2ffa4c66ae81fb08edd7dde0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:14Z,use_quota=True,user_id='4209e723624f418eb10b3456874955ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Creating volume 715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:14 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d 2147483648 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:14 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d 2147483648 Apr 09 17:39:14 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:14 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d 2147483648" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:14 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d Apr 09 17:39:14 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:15 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d" returned: 0 in 0.407s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf903f3-965e-448e-98f2-340e28af76c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715e58d1-f675-4704-a4df-400606ee492d', 'volume_size': 2}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35805fd-d467-4ac7-8b85-ed03b53bcebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:15 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Volume volume-715e58d1-f675-4704-a4df-400606ee492d (715e58d1-f675-4704-a4df-400606ee492d): created successfully Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35805fd-d467-4ac7-8b85-ed03b53bcebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Flow 'volume_create_manager' (6627ac76-f08a-49ac-b28c-189eb345e98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:15 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-bafc03e5-73e7-45ae-812e-e9e10e8d8c1d tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Created volume successfully. Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Creating offline snapshot 01627f29-6102-4132-a7b8-0ea9bb99654b of volume 715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c484133a-9127-44fe-83d6-b2aaa5087e8b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:16 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d Apr 09 17:39:16 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:16 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b 2G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:16 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b 2G Apr 09 17:39:16 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:17 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b 2G" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715e58d1-f675-4704-a4df-400606ee492d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:17 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715e58d1-f675-4704-a4df-400606ee492d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b Apr 09 17:39:17 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:17 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715e58d1-f675-4704-a4df-400606ee492d -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b" returned: 0 in 0.422s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:17 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b is being set with open permissions: ugo+rw Apr 09 17:39:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:17 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b Apr 09 17:39:17 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:18 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b" returned: 0 in 0.397s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:18 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info Apr 09 17:39:18 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:18 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info" returned: 0 in 0.401s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:18 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info is being set with open permissions: ugo+rw Apr 09 17:39:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:18 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info Apr 09 17:39:18 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:18 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.info" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d0978d42-66c7-4639-bd61-ab445082816a tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Create snapshot completed successfully Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "cinder-01627f29-6102-4132-a7b8-0ea9bb99654b-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-01627f29-6102-4132-a7b8-0ea9bb99654b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "cinder-quobyte-715e58d1-f675-4704-a4df-400606ee492d" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-quobyte-715e58d1-f675-4704-a4df-400606ee492d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "cinder-quobyte-01627f29-6102-4132-a7b8-0ea9bb99654b" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-quobyte-01627f29-6102-4132-a7b8-0ea9bb99654b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Deleting offline snapshot 01627f29-6102-4132-a7b8-0ea9bb99654b of volume 715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] snapshot_file for this snap is: volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30ff934-4c5e-4f57-aa63-13aff70489ca]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:19 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b Apr 09 17:39:19 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:19 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b" returned: 0 in 0.456s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715e58d1-f675-4704-a4df-400606ee492d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b352b794-7129-4924-bf6b-ac6383d9821a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:20 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d Apr 09 17:39:20 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:20 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d" returned: 0 in 0.459s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:20 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b Apr 09 17:39:20 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:20 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b" returned: 0 in 0.442s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:20 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b Apr 09 17:39:20 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:21 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d.01627f29-6102-4132-a7b8-0ea9bb99654b" returned: 0 in 0.397s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-quobyte-01627f29-6102-4132-a7b8-0ea9bb99654b" released by "_delete_snapshot" :: held 1.807s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-quobyte-715e58d1-f675-4704-a4df-400606ee492d" released by "delete_snapshot" :: held 1.820s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Created reservations ['75d0a7dd-7928-4845-a371-e1e3e3cf0e3b', 'b9e85d08-6961-41f3-a5d0-bd67ac34aca4', '96fe4c4a-b56e-492c-af3e-53efc47e57ca', '022c605d-af13-4bb9-84ae-5e279f711224'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:21 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Delete snapshot completed successfully. Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-eb79623c-7976-420b-b31e-d6680024dfad tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-01627f29-6102-4132-a7b8-0ea9bb99654b-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "cinder-715e58d1-f675-4704-a4df-400606ee492d-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-715e58d1-f675-4704-a4df-400606ee492d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "cinder-quobyte-715e58d1-f675-4704-a4df-400606ee492d" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-quobyte-715e58d1-f675-4704-a4df-400606ee492d" acquired by "delete_volume" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f793213-1058-4b23-9b31-ac17dce10a7c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:21 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d Apr 09 17:39:21 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:22 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:22 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d Apr 09 17:39:22 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:22 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-715e58d1-f675-4704-a4df-400606ee492d" returned: 0 in 0.406s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-quobyte-715e58d1-f675-4704-a4df-400606ee492d" released by "delete_volume" :: held 0.881s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Created reservations ['7f0f4031-3380-4f54-ae57-f810af120477', '6d69fa4c-7234-454c-8a8a-99773c7ec187', 'ea361883-620d-4e66-8321-f480f0b76cd8', '10348fa2-42d3-4186-9600-0d1af3db3265'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:22 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:22 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:23 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.505s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:23 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Deleted volume successfully. Apr 09 17:39:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-0367554e-7300-4ec3-916f-f6eb355e7e8e tempest-VolumesSnapshotNegativeTestJSON-704447412 None] Lock "cinder-715e58d1-f675-4704-a4df-400606ee492d-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (6d41a791-b8e4-4cb4-bfd9-ccc08463f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4639cc1-ae64-479a-8244-bd682893f85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4639cc1-ae64-479a-8244-bd682893f85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1749748933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2112f1b-07cd-4bfb-b85c-b3538dee62e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:24Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0e2a67-b3fc-449c-911c-4ccbe144fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0e2a67-b3fc-449c-911c-4ccbe144fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937fd217-e584-4e5e-a8d7-eafe23f96466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937fd217-e584-4e5e-a8d7-eafe23f96466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2112f1b-07cd-4bfb-b85c-b3538dee62e4', 'volume_name': 'volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c862b192-eb1d-423b-951b-4fcbb66fd021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c862b192-eb1d-423b-951b-4fcbb66fd021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0dda2d-e319-43b3-a053-d9011b62e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:24 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume e2112f1b-07cd-4bfb-b85c-b3538dee62e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4', 'volume_size': 1} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1749748933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2112f1b-07cd-4bfb-b85c-b3538dee62e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:24Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating volume e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:24 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:24 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 1073741824 Apr 09 17:39:24 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:24 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 1073741824" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:24 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 Apr 09 17:39:24 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:25 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" returned: 0 in 0.397s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0dda2d-e319-43b3-a053-d9011b62e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cadc3c-0766-4532-8964-3a6e0509f356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 (e2112f1b-07cd-4bfb-b85c-b3538dee62e4): created successfully Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cadc3c-0766-4532-8964-3a6e0509f356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (6d41a791-b8e4-4cb4-bfd9-ccc08463f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-320c7ae8-6f19-41d3-ac30-33a23bd1d47b tempest-CreateVolumesFromSnapshotTest-893630476 None] Created volume successfully. Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating offline snapshot f736ac27-8141-43fc-9064-8f0a18f7cc92 of volume e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1906db77-beda-437e-82f2-69e93bf60bff]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:25 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 Apr 09 17:39:25 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:25 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:25 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 1G Apr 09 17:39:25 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:26 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 1G" returned: 0 in 0.451s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:26 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 Apr 09 17:39:26 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:26 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92" returned: 0 in 0.433s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:26 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 is being set with open permissions: ugo+rw Apr 09 17:39:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:26 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 Apr 09 17:39:26 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:27 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92" returned: 0 in 0.396s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:27 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info Apr 09 17:39:27 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:27 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info" returned: 0 in 0.401s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:27 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info is being set with open permissions: ugo+rw Apr 09 17:39:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:27 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info Apr 09 17:39:27 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:28 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.info" returned: 0 in 0.391s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:28 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6cad72e0-3783-4c8f-a746-168fabfafa15 tempest-CreateVolumesFromSnapshotTest-893630476 None] Create snapshot completed successfully Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (bbd0b4ad-73e2-4e2e-b0d4-363f9bf43b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5aebe6c-ce22-4f4c-a9da-e00525bf3a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5aebe6c-ce22-4f4c-a9da-e00525bf3a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2110284293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae5aafa-bd18-4438-a72e-52f247a336ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abc68ee-82b5-4178-8c2c-40dd7a871bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abc68ee-82b5-4178-8c2c-40dd7a871bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c05a823-6f1b-4aec-a60a-eb637b0aeced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c05a823-6f1b-4aec-a60a-eb637b0aeced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae5aafa-bd18-4438-a72e-52f247a336ba', 'volume_name': 'volume-4ae5aafa-bd18-4438-a72e-52f247a336ba', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd52d12a-95a8-405f-80cf-e2427966e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd52d12a-95a8-405f-80cf-e2427966e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23417444-d253-443e-90da-99b013c19729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:28 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume 4ae5aafa-bd18-4438-a72e-52f247a336ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae5aafa-bd18-4438-a72e-52f247a336ba', 'volume_size': 1} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2110284293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae5aafa-bd18-4438-a72e-52f247a336ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating volume 4ae5aafa-bd18-4438-a72e-52f247a336ba {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:28 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:28 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba 1073741824 Apr 09 17:39:28 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (8e3d6f09-8a5d-4ae3-8028-7dd21dd2f446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861c383-301f-4c20-90ec-894ac48ae595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861c383-301f-4c20-90ec-894ac48ae595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744622528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8cabb0-7f80-4578-b720-923b4cb6a16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85de5895-f76b-44ed-a6d6-9a640adbec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85de5895-f76b-44ed-a6d6-9a640adbec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2da5824-1152-41ab-91b3-3b21f69b64f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2da5824-1152-41ab-91b3-3b21f69b64f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8cabb0-7f80-4578-b720-923b4cb6a16e', 'volume_name': 'volume-be8cabb0-7f80-4578-b720-923b4cb6a16e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c2ce7b-bf6d-43ba-b69f-b1028745a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c2ce7b-bf6d-43ba-b69f-b1028745a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde3cf60-60d8-4c11-99c9-b0ade832e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume be8cabb0-7f80-4578-b720-923b4cb6a16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8cabb0-7f80-4578-b720-923b4cb6a16e', 'volume_size': 1} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (3233cbc9-aae7-4284-8a5f-e220bb81cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7abb670-38b0-4499-859c-9ea1e32c3469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7abb670-38b0-4499-859c-9ea1e32c3469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1767879375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64741cab-f88c-4b25-998f-bc3dc5fda607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52763422-e1f2-4cb3-ba4a-7490b49dc41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52763422-e1f2-4cb3-ba4a-7490b49dc41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c31cb01-5ecf-4910-b3d9-5bfc38ba106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c31cb01-5ecf-4910-b3d9-5bfc38ba106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64741cab-f88c-4b25-998f-bc3dc5fda607', 'volume_name': 'volume-64741cab-f88c-4b25-998f-bc3dc5fda607', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe585103-11aa-4a41-820b-4c56c3127f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe585103-11aa-4a41-820b-4c56c3127f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52090da-7877-47e6-b721-d66850b42887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume 64741cab-f88c-4b25-998f-bc3dc5fda607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64741cab-f88c-4b25-998f-bc3dc5fda607', 'volume_size': 1} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (105f5e33-35b3-44d9-9e8d-303dc90ac2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1ee64f-a8c1-46a6-9b2a-f858e2e52c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1ee64f-a8c1-46a6-9b2a-f858e2e52c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017149354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282d2c2e-678b-4b8e-a1a5-a6d3afb616ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd50515-b39b-4a9e-adb9-f259dfa60886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd50515-b39b-4a9e-adb9-f259dfa60886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b352af-2382-4073-b39f-7f9581c21279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b352af-2382-4073-b39f-7f9581c21279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282d2c2e-678b-4b8e-a1a5-a6d3afb616ff', 'volume_name': 'volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cf57e1-77da-4c4b-8762-1540817fbb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cf57e1-77da-4c4b-8762-1540817fbb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5a2796-f23e-457a-a7a6-1a760c15cbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume 282d2c2e-678b-4b8e-a1a5-a6d3afb616ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff', 'volume_size': 1} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba 1073741824" returned: 0 in 0.563s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:29 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba Apr 09 17:39:29 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (6e2efa7c-0ddb-4f12-988b-a33522734544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b88c02-dd17-4415-9d60-cc8019277062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b88c02-dd17-4415-9d60-cc8019277062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965350163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b757e2-47a1-47fb-ba6c-39cd31cb22a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3a8cef-2866-4297-8e3f-4099ef23aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3a8cef-2866-4297-8e3f-4099ef23aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b70a9c-0253-4ddc-94e5-24546d3c2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b70a9c-0253-4ddc-94e5-24546d3c2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b757e2-47a1-47fb-ba6c-39cd31cb22a8', 'volume_name': 'volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360c4448-2607-46e7-94d2-87920c5dc73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360c4448-2607-46e7-94d2-87920c5dc73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fba30d-9f4c-4963-a0b8-4802831848e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume 71b757e2-47a1-47fb-ba6c-39cd31cb22a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8', 'volume_size': 1} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:29 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba" returned: 0 in 0.418s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744622528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8cabb0-7f80-4578-b720-923b4cb6a16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating volume be8cabb0-7f80-4578-b720-923b4cb6a16e {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:29 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e 1073741824 Apr 09 17:39:29 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23417444-d253-443e-90da-99b013c19729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae5aafa-bd18-4438-a72e-52f247a336ba', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdad250-6b85-4e36-9760-e1ff73a31ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume volume-4ae5aafa-bd18-4438-a72e-52f247a336ba (4ae5aafa-bd18-4438-a72e-52f247a336ba): created successfully Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdad250-6b85-4e36-9760-e1ff73a31ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (bbd0b4ad-73e2-4e2e-b0d4-363f9bf43b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:29 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-434539d5-3179-4b78-b901-d7c94e67c0e3 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created volume successfully. Apr 09 17:39:30 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e 1073741824" returned: 0 in 0.480s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:30 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e Apr 09 17:39:30 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:30 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1767879375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64741cab-f88c-4b25-998f-bc3dc5fda607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating volume 64741cab-f88c-4b25-998f-bc3dc5fda607 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:30 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde3cf60-60d8-4c11-99c9-b0ade832e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8cabb0-7f80-4578-b720-923b4cb6a16e', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:30 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 1073741824 Apr 09 17:39:30 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194b32c9-89df-4b2c-8516-365cf7170f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:30 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume volume-be8cabb0-7f80-4578-b720-923b4cb6a16e (be8cabb0-7f80-4578-b720-923b4cb6a16e): created successfully Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194b32c9-89df-4b2c-8516-365cf7170f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (8e3d6f09-8a5d-4ae3-8028-7dd21dd2f446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ff6fc3ab-e85c-41fb-8404-31147648147d tempest-CreateVolumesFromSnapshotTest-893630476 None] Created volume successfully. Apr 09 17:39:31 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 1073741824" returned: 0 in 0.487s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:31 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 Apr 09 17:39:31 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:31 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607" returned: 0 in 0.425s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.329s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017149354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282d2c2e-678b-4b8e-a1a5-a6d3afb616ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating volume 282d2c2e-678b-4b8e-a1a5-a6d3afb616ff {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:31 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52090da-7877-47e6-b721-d66850b42887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64741cab-f88c-4b25-998f-bc3dc5fda607', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb8f87e-e71a-4796-b3f2-b95cad46f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:31 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff 1073741824 Apr 09 17:39:31 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:31 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume volume-64741cab-f88c-4b25-998f-bc3dc5fda607 (64741cab-f88c-4b25-998f-bc3dc5fda607): created successfully Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb8f87e-e71a-4796-b3f2-b95cad46f402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (3233cbc9-aae7-4284-8a5f-e220bb81cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:31 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-6aab9193-5ba7-4a00-b70a-ae8abc131a37 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created volume successfully. Apr 09 17:39:32 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff 1073741824" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:32 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff Apr 09 17:39:32 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:32 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff" returned: 0 in 0.425s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965350163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b757e2-47a1-47fb-ba6c-39cd31cb22a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08190f7dfcd4a04b8e426b009ea8bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:29Z,use_quota=True,user_id='9d0471943f9346a69aa92e7a04762a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Creating volume 71b757e2-47a1-47fb-ba6c-39cd31cb22a8 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:32 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:32 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 1073741824 Apr 09 17:39:32 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5a2796-f23e-457a-a7a6-1a760c15cbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa9763-b0d0-49dc-a760-0d0b48ca1293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:32 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff (282d2c2e-678b-4b8e-a1a5-a6d3afb616ff): created successfully Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa9763-b0d0-49dc-a760-0d0b48ca1293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (105f5e33-35b3-44d9-9e8d-303dc90ac2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:32 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1f5bf376-7c93-499e-af0c-b583c8099e27 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created volume successfully. Apr 09 17:39:33 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 1073741824" returned: 0 in 0.498s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:33 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 Apr 09 17:39:33 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:33 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8" returned: 0 in 0.408s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fba30d-9f4c-4963-a0b8-4802831848e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ad8a43-402b-423c-9cb6-1336d88f3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:33 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Volume volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 (71b757e2-47a1-47fb-ba6c-39cd31cb22a8): created successfully Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ad8a43-402b-423c-9cb6-1336d88f3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Flow 'volume_create_manager' (6e2efa7c-0ddb-4f12-988b-a33522734544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:33 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-8a98132c-4690-408a-acee-e0c8ebafa45f tempest-CreateVolumesFromSnapshotTest-893630476 None] Created volume successfully. Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-71b757e2-47a1-47fb-ba6c-39cd31cb22a8-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-71b757e2-47a1-47fb-ba6c-39cd31cb22a8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-71b757e2-47a1-47fb-ba6c-39cd31cb22a8" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-71b757e2-47a1-47fb-ba6c-39cd31cb22a8" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd9404-496c-4c76-967b-6db7415cfc7a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:34 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 Apr 09 17:39:34 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:34 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8" returned: 0 in 0.463s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:34 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8 Apr 09 17:39:34 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:34 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-71b757e2-47a1-47fb-ba6c-39cd31cb22a8" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-71b757e2-47a1-47fb-ba6c-39cd31cb22a8" released by "delete_volume" :: held 0.901s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['5cb4e536-d4cc-42db-b35c-8b2faa415889', '6c72ad41-8fc4-45c0-a5b3-3c5f8582ef69', '672105c6-47c1-47e2-90e6-97d041457396', '746e0caa-5e53-41d1-a935-78e121a2f3d0'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:34 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:34 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d13d5f6-147d-4371-9280-73af273cafe3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:35 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff Apr 09 17:39:35 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:35 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.438s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleted volume successfully. Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-121ac8e8-eb08-4f01-bb49-d0ad23855397 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-71b757e2-47a1-47fb-ba6c-39cd31cb22a8-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:35 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff" returned: 0 in 0.486s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:35 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff Apr 09 17:39:35 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:35 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff" returned: 0 in 0.404s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff" released by "delete_volume" :: held 0.913s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:35 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['c68e5081-04b9-45ad-8685-ad2ab8dda183', 'd7df1264-1b61-4876-9187-425bcd0430b7', 'c25c66c9-04ec-4e34-8117-85647ad876b8', '2058e30b-f68c-488f-bbc0-ac63d774a495'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:36 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:36 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-64741cab-f88c-4b25-998f-bc3dc5fda607-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-64741cab-f88c-4b25-998f-bc3dc5fda607-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-64741cab-f88c-4b25-998f-bc3dc5fda607" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-64741cab-f88c-4b25-998f-bc3dc5fda607" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[805835d1-acad-4c75-a7bf-5534636424c3]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:36 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 Apr 09 17:39:36 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:36 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:36 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleted volume successfully. Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a047ccd2-0892-4ef3-8015-a18eff6d3823 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-282d2c2e-678b-4b8e-a1a5-a6d3afb616ff-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:36 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:36 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607 Apr 09 17:39:36 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:37 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64741cab-f88c-4b25-998f-bc3dc5fda607" returned: 0 in 0.403s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-64741cab-f88c-4b25-998f-bc3dc5fda607" released by "delete_volume" :: held 0.907s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['5e37219f-1ce7-42d4-956f-19223f43b4b7', 'f43f53d5-429f-4302-9682-b341c0ae9e5f', '40e041bd-efde-43cd-8dba-c8be337c7805', '3f2c0639-2b2c-4927-8dba-d0e6836c6246'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:37 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:37 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-be8cabb0-7f80-4578-b720-923b4cb6a16e-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-be8cabb0-7f80-4578-b720-923b4cb6a16e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-be8cabb0-7f80-4578-b720-923b4cb6a16e" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-be8cabb0-7f80-4578-b720-923b4cb6a16e" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae094d85-7dc5-41a3-adce-57c2f83c0c85]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:37 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e Apr 09 17:39:37 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:37 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.456s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:37 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleted volume successfully. Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-c8a111c4-b178-4678-85ee-31a2ffe36734 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-64741cab-f88c-4b25-998f-bc3dc5fda607-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:37 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:37 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e Apr 09 17:39:37 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:38 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-be8cabb0-7f80-4578-b720-923b4cb6a16e" returned: 0 in 0.400s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-be8cabb0-7f80-4578-b720-923b4cb6a16e" released by "delete_volume" :: held 0.892s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['eb1f4b60-d12a-4209-af89-01d4161b39e9', '733ba15a-ab7e-4bcb-b1ab-10c418446d75', '83f43f9c-23ae-41fa-b493-f36b12f07430', 'ddb7e819-9ace-4d8f-b5a5-a26164b8540c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:38 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:38 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-4ae5aafa-bd18-4438-a72e-52f247a336ba-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-4ae5aafa-bd18-4438-a72e-52f247a336ba-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-4ae5aafa-bd18-4438-a72e-52f247a336ba" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-4ae5aafa-bd18-4438-a72e-52f247a336ba" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d2daad-745b-449c-a431-ff3688635dd7]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:38 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba Apr 09 17:39:38 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:38 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.408s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:38 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleted volume successfully. Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1429db0d-90aa-4dd9-8a87-94cda4e03bc4 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-be8cabb0-7f80-4578-b720-923b4cb6a16e-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:38 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:38 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba Apr 09 17:39:38 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:39 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4ae5aafa-bd18-4438-a72e-52f247a336ba" returned: 0 in 0.392s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-4ae5aafa-bd18-4438-a72e-52f247a336ba" released by "delete_volume" :: held 0.888s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['6a57ea56-242c-46b0-b0e9-ce6795b6589b', '826b5100-5974-4810-b3b8-f0ceaceb2823', 'fd87dd99-f9b8-4847-a595-e6d1f502a8ff', '64fd55a0-fe9c-4832-bf31-f90eb1eee92e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:39 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:39 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-f736ac27-8141-43fc-9064-8f0a18f7cc92-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-f736ac27-8141-43fc-9064-8f0a18f7cc92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-f736ac27-8141-43fc-9064-8f0a18f7cc92" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-f736ac27-8141-43fc-9064-8f0a18f7cc92" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleting offline snapshot f736ac27-8141-43fc-9064-8f0a18f7cc92 of volume e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] snapshot_file for this snap is: volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[93168284-1909-4a67-8be5-9fd4c5aecb94]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:39 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 Apr 09 17:39:39 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:39 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.414s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleted volume successfully. Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b002b17e-026b-46b3-ab6e-9387f3ccf933 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-4ae5aafa-bd18-4438-a72e-52f247a336ba-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:39 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92" returned: 0 in 0.467s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a19605-24dc-4cf6-8dd7-62f9bee50980]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:40 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 Apr 09 17:39:40 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:40 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:40 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 Apr 09 17:39:40 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:40 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:40 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92 Apr 09 17:39:40 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:41 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4.f736ac27-8141-43fc-9064-8f0a18f7cc92" returned: 0 in 0.398s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-f736ac27-8141-43fc-9064-8f0a18f7cc92" released by "_delete_snapshot" :: held 1.809s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" released by "delete_snapshot" :: held 1.827s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['7e00c44c-d6d1-4a9d-a668-f4e75c1522f8', '706debe4-f67d-42c2-a521-af4c8485258e', 'f9928d71-8ff4-4664-88e2-33400946deff', '89f01df2-d2c4-41dc-8e55-eac3ac6ed686'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Delete snapshot completed successfully. Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-72032906-f560-413f-aeab-65e5aba08944 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-f736ac27-8141-43fc-9064-8f0a18f7cc92-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-e2112f1b-07cd-4bfb-b85c-b3538dee62e4-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-e2112f1b-07cd-4bfb-b85c-b3538dee62e4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=111,cinder:UPDATE=158,cinder:INSERT=34,cinder:DELETE=12 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "cinder-quobyte-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97661e-550f-475a-8bcb-22e13fa7da77]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:39:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:41 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 Apr 09 17:39:41 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:42 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" returned: 0 in 0.462s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:42 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4 Apr 09 17:39:42 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:42 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" returned: 0 in 0.398s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-quobyte-e2112f1b-07cd-4bfb-b85c-b3538dee62e4" released by "delete_volume" :: held 0.888s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Created reservations ['de270716-c15e-4e88-8c8c-ca0e903b1861', 'd52e76ae-ea4e-4ac9-8cc0-d230ae364b76', '25e2d568-c632-4fd0-a71c-8d61c2189a6b', '60c34824-5cfb-496f-b1be-c66ee13bcf83'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:42 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:39:42 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:43 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.489s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:43 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:39:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Deleted volume successfully. Apr 09 17:39:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-7f7b70b9-30f9-488b-b0a2-eccc87e68897 tempest-CreateVolumesFromSnapshotTest-893630476 None] Lock "cinder-e2112f1b-07cd-4bfb-b85c-b3538dee62e4-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:39:52 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:INSERT=27,cinder:UPDATE=110,cinder:SELECT=71,cinder:DELETE=11 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:39:53 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Flow 'volume_create_manager' (16832486-054f-4401-b9d7-c9875a0568ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0993c68-6696-4291-b1e8-1924474b515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0993c68-6696-4291-b1e8-1924474b515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-863558901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87e21410688442fbd4c820c804d9713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:59Z,use_quota=True,user_id='84aa1b28dca14db884fdbe898934cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9a3aea-e713-4909-ade7-d9d6dba25195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9a3aea-e713-4909-ade7-d9d6dba25195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1fae08-f755-4369-ae47-02f7a82227cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1fae08-f755-4369-ae47-02f7a82227cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68', 'volume_name': 'volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd13f6e6-8d3f-4ce3-9c53-821a78e40761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd13f6e6-8d3f-4ce3-9c53-821a78e40761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eae5618-022b-4aa5-a157-fbecc4c7dc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:58 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Volume a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68', 'volume_size': 1} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-863558901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87e21410688442fbd4c820c804d9713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:39:59Z,use_quota=True,user_id='84aa1b28dca14db884fdbe898934cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Creating volume a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:39:58 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:39:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:58 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 1073741824 Apr 09 17:39:58 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:59 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 1073741824" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:39:59 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:39:59 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:39:59 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eae5618-022b-4aa5-a157-fbecc4c7dc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47e149c-9f88-4a97-a427-23cf0e35c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:39:59 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Volume volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 (a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68): created successfully Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47e149c-9f88-4a97-a427-23cf0e35c561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:39:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Flow 'volume_create_manager' (16832486-054f-4401-b9d7-c9875a0568ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:39:59 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ffa644d5-2d9c-445a-ab5e-96534e0c23f8 tempest-SnapshotDependencyTests-1063652757 None] Created volume successfully. Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Creating offline snapshot 473ee42b-31fc-4422-a840-e4436180f851 of volume a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8b6112-3e28-46ef-b4fb-6112e5577bb0]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:01 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:40:01 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:01 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:01 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 1G Apr 09 17:40:01 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:02 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 1G" returned: 0 in 0.465s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:02 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 Apr 09 17:40:02 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:02 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851" returned: 0 in 0.430s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:02 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 is being set with open permissions: ugo+rw Apr 09 17:40:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:02 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 Apr 09 17:40:02 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:02 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:02 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info Apr 09 17:40:02 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:03 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info" returned: 0 in 0.409s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:03 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info is being set with open permissions: ugo+rw Apr 09 17:40:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:03 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info Apr 09 17:40:03 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:03 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.info" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:03 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0f2dd82b-d512-4f03-bb04-a4a02cdc28c6 tempest-SnapshotDependencyTests-1063652757 None] Create snapshot completed successfully Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Flow 'volume_create_manager' (cbac026a-f4a3-42e2-9263-793d60b6f687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0063de10-340f-42bf-acea-5e2e3da4eb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0063de10-340f-42bf-acea-5e2e3da4eb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87e21410688442fbd4c820c804d9713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=473ee42b-31fc-4422-a840-e4436180f851,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:05Z,use_quota=True,user_id='84aa1b28dca14db884fdbe898934cf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fc45cc-ece0-480f-bdb8-b7eaba41eac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fc45cc-ece0-480f-bdb8-b7eaba41eac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7d20c5-bdeb-4297-8471-f1c9c267eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7d20c5-bdeb-4297-8471-f1c9c267eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe', 'volume_name': 'volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe', 'volume_size': 1, 'snapshot_id': '473ee42b-31fc-4422-a840-e4436180f851'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861e5e4d-0925-4bef-9cda-a9af0e9db212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861e5e4d-0925-4bef-9cda-a9af0e9db212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd888cce-6bee-4ef5-ac58-12528185973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Volume 3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe', 'volume_size': 1, 'snapshot_id': '473ee42b-31fc-4422-a840-e4436180f851'} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-quobyte-473ee42b-31fc-4422-a840-e4436180f851-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-473ee42b-31fc-4422-a840-e4436180f851-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Creating volume 3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe from snapshot 473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-quobyte-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] snapshot: 473ee42b-31fc-4422-a840-e4436180f851, volume: 3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc18ef7-2036-4e89-9cd9-71dc27dd1e62]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:04 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 Apr 09 17:40:04 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:05 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851" returned: 0 in 0.475s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2fd42-32a7-4dad-ab74-ef187928784f]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:05 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:40:05 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:05 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:40:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:05 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe Apr 09 17:40:05 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:07 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" returned: 0 in 1.925s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f047a7b5-8053-4c18-a778-339a3be22229]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:07 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:40:07 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:08 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:40:08 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Converted 1024.00 MB image at 531.49 MB/s Apr 09 17:40:08 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe is being set with open permissions: ugo+rw Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:08 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe Apr 09 17:40:08 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:08 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:08 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:08 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" returned: 0 in 0.407s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" released by "_copy_volume_from_snapshot" :: held 3.924s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-473ee42b-31fc-4422-a840-e4436180f851-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" released by "_create_volume_from_snapshot" :: held 3.938s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.946s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd888cce-6bee-4ef5-ac58-12528185973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe', 'volume_size': 1, 'snapshot_id': '473ee42b-31fc-4422-a840-e4436180f851'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c73b27-174b-48b3-ac8a-00d678554d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:08 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Volume volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe (3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe): created successfully Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c73b27-174b-48b3-ac8a-00d678554d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Flow 'volume_create_manager' (cbac026a-f4a3-42e2-9263-793d60b6f687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:08 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d6e45b6f-7fa6-4612-9071-3656ad453ef2 tempest-SnapshotDependencyTests-1063652757 None] Created volume successfully. Apr 09 17:40:08 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.416s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-473ee42b-31fc-4422-a840-e4436180f851-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-473ee42b-31fc-4422-a840-e4436180f851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-quobyte-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-quobyte-473ee42b-31fc-4422-a840-e4436180f851" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-473ee42b-31fc-4422-a840-e4436180f851" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Deleting offline snapshot 473ee42b-31fc-4422-a840-e4436180f851 of volume a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] snapshot_file for this snap is: volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a027ed3-35a4-47a9-aa76-7df4b2256ea8]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:09 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 Apr 09 17:40:09 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:09 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:09 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:40:09 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e0b1cf-f1e9-43c9-8fee-0b4b9ea9bc34]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:09 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:40:09 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:09 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:09 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 Apr 09 17:40:09 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:10 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:10 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851 Apr 09 17:40:10 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:10 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68.473ee42b-31fc-4422-a840-e4436180f851" returned: 0 in 0.402s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-473ee42b-31fc-4422-a840-e4436180f851" released by "_delete_snapshot" :: held 1.814s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" released by "delete_snapshot" :: held 1.823s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Created reservations ['f4e67c3a-5d25-4102-9fb4-fdb3a7f6057c', '6d676674-9592-433d-8fcd-50d26d844b85', '398595a9-c85b-423e-a30a-619543e8a61b', 'c76f20c1-23f7-4f64-8b71-d3285fc33812'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:10 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Delete snapshot completed successfully. Apr 09 17:40:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ec83eb5e-4cd8-4704-8668-6df3908ea6f3 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-473ee42b-31fc-4422-a840-e4436180f851-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-quobyte-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6726ad-21aa-4fa6-bf6d-081d42f63d9c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:11 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:40:11 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:11 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:11 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68 Apr 09 17:40:11 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:11 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" returned: 0 in 0.425s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68" released by "delete_volume" :: held 0.908s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Created reservations ['2fe7a21c-d2ef-4938-84e3-1ff65dac0e2f', '86806058-e676-49e5-8202-01c5a77f3f35', '02db6493-2254-4cae-8aad-e4938ecab32b', '9225e143-9802-481d-b0be-29800b181ccf'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:12 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:12 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "cinder-quobyte-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c8c06-b76a-4824-b033-d1d795d4ed2d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:12 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe Apr 09 17:40:12 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:12 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.424s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:12 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Deleted volume successfully. Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ee3ce233-dbe3-4691-99a8-5bb489058266 tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-a0387eb4-4df6-4f4a-9cdd-9fa3f8dedf68-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:12 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" returned: 0 in 0.462s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:12 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe Apr 09 17:40:12 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:13 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-quobyte-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe" released by "delete_volume" :: held 0.896s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Created reservations ['a2fb6050-1c8d-4ea8-a551-6b5fd80729dd', 'c2d8ea53-4b0d-471c-80cd-741de0a79110', '3cca93f4-9766-4512-a427-02a391a106b8', '93df9821-8022-48df-adc3-e5bb4b5df36e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:13 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:13 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:13 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:13 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Deleted volume successfully. Apr 09 17:40:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-24061118-ee36-4692-b12a-b858fece9cbc tempest-SnapshotDependencyTests-1063652757 None] Lock "cinder-3e688b3d-f2da-4d0c-a149-bfdea5f9cdfe-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:23 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:UPDATE=31,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:40:23 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=3 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (dbc4c520-631e-4bb8-b107-c2cda9a54a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a379f3-d46c-4338-bbef-ac4dac4d6ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a379f3-d46c-4338-bbef-ac4dac4d6ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1838765724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b08067-50b8-44e0-9f09-f80cfdffcfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966e097529b46d8b60791d7e1a50033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:25Z,use_quota=True,user_id='c20f49120c974c41ba8ce2afd7dac036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07315b32-141f-4646-8414-ec5d83534629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07315b32-141f-4646-8414-ec5d83534629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7921018b-c40d-4b59-99dd-8cb7225362f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7921018b-c40d-4b59-99dd-8cb7225362f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b08067-50b8-44e0-9f09-f80cfdffcfe9', 'volume_name': 'volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104a8e76-1af1-4060-b291-e73bba5836a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104a8e76-1af1-4060-b291-e73bba5836a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e64bb6-2860-418e-91fa-65bbfb001025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Volume b0b08067-50b8-44e0-9f09-f80cfdffcfe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9', 'volume_size': 1} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1838765724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b08067-50b8-44e0-9f09-f80cfdffcfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966e097529b46d8b60791d7e1a50033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:25Z,use_quota=True,user_id='c20f49120c974c41ba8ce2afd7dac036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Creating volume b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:25 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:25 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 1073741824 Apr 09 17:40:25 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (a46e322a-fe10-43b6-9021-dd6871d80dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24cdc19-c405-41ca-b983-308fd6054665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24cdc19-c405-41ca-b983-308fd6054665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-453079723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:25Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f61ca0-50d2-419c-be73-16707340a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f61ca0-50d2-419c-be73-16707340a109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b662e23d-598f-4ff6-9923-4bb150208742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b662e23d-598f-4ff6-9923-4bb150208742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9', 'volume_name': 'volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8279da7d-5f06-45e5-a5e9-daf3829d00ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8279da7d-5f06-45e5-a5e9-daf3829d00ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac32dc19-018b-4f11-808e-9e06608087b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume 4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9', 'volume_size': 1} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (facc9b1a-90d4-4f90-9d25-29304eec6b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7166a5d-236e-4b90-8f9d-9b3043788b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7166a5d-236e-4b90-8f9d-9b3043788b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740812158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ecaebc-521d-4c6d-b7a1-6497c7e5d119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:25Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f58a650-8e0f-4367-beae-ecbc227c4424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f58a650-8e0f-4367-beae-ecbc227c4424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624413d2-78d3-4827-a449-9affe7266bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624413d2-78d3-4827-a449-9affe7266bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ecaebc-521d-4c6d-b7a1-6497c7e5d119', 'volume_name': 'volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03eb8182-4401-4d7e-bd80-01053cb7be1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03eb8182-4401-4d7e-bd80-01053cb7be1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687fa11c-05de-430e-aed4-d1d9315c1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Volume 79ecaebc-521d-4c6d-b7a1-6497c7e5d119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119', 'volume_size': 1} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (88dcab86-1b46-43c7-89f5-3d939d7710c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f7e725-8383-4cd0-a961-573618b92ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f7e725-8383-4cd0-a961-573618b92ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1328710213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:26Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f079b5bd-bce9-4938-a089-39008567c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f079b5bd-bce9-4938-a089-39008567c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1312deef-65db-44c0-9b9f-6ed5d00a69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1312deef-65db-44c0-9b9f-6ed5d00a69db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c', 'volume_name': 'volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1625c690-2bae-4b02-b9db-88649ff47834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1625c690-2bae-4b02-b9db-88649ff47834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfec5e1-0aca-4b61-bbd9-1241b9471d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:25 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Volume 1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c', 'volume_size': 1} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 1073741824" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:25 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:25 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (173cb683-b63d-44c3-88c5-93888ff686b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558df7b9-13d7-4a9d-a1e0-110141100fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558df7b9-13d7-4a9d-a1e0-110141100fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962924681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5011fc31-55a2-4267-bcd2-5fa09eed3df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:26Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfa5c6f-757c-4ee0-be1d-951443b71405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfa5c6f-757c-4ee0-be1d-951443b71405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65206716-f93a-4fdd-b1d2-3aa0a56ca86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65206716-f93a-4fdd-b1d2-3aa0a56ca86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5011fc31-55a2-4267-bcd2-5fa09eed3df1', 'volume_name': 'volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a18a73-71c8-471b-9cfe-cc61996ff655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a18a73-71c8-471b-9cfe-cc61996ff655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d282c3-310c-49a8-9e04-4a79bd230758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Volume 5011fc31-55a2-4267-bcd2-5fa09eed3df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1', 'volume_size': 1} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:26 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.968s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-453079723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:25Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating volume 4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:26 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:26 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 1073741824 Apr 09 17:40:26 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e64bb6-2860-418e-91fa-65bbfb001025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9700e2b-eea3-4e2d-84d0-0cac17c6f640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Volume volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 (b0b08067-50b8-44e0-9f09-f80cfdffcfe9): created successfully Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9700e2b-eea3-4e2d-84d0-0cac17c6f640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (dbc4c520-631e-4bb8-b107-c2cda9a54a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (718652a4-5657-4a29-b172-7fa4c439f454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b4824-385a-401c-b6a5-8ffc8870c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d866b989-8997-4649-a0f4-b3f3f85bb770 tempest-VolumeDependencyTests-964238354 None] Created volume successfully. Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2b4824-385a-401c-b6a5-8ffc8870c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452353376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500d6708-8298-4fd9-9ca7-7bbeefffa164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:26Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d777e9e-1cf9-4f91-b8c5-815bd069f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d777e9e-1cf9-4f91-b8c5-815bd069f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4198bd8b-cf04-4b8c-8fc4-1f1262ec1618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4198bd8b-cf04-4b8c-8fc4-1f1262ec1618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500d6708-8298-4fd9-9ca7-7bbeefffa164', 'volume_name': 'volume-500d6708-8298-4fd9-9ca7-7bbeefffa164', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1d4f23-183a-40af-981c-04f3e499b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1d4f23-183a-40af-981c-04f3e499b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50b5278-bd89-4108-a1f9-5f8d403a6060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Volume 500d6708-8298-4fd9-9ca7-7bbeefffa164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500d6708-8298-4fd9-9ca7-7bbeefffa164', 'volume_size': 1} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (eece2573-1b94-4311-a77f-46f497d0b6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470da66d-dec4-4b9f-b28a-76abf5a44c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470da66d-dec4-4b9f-b28a-76abf5a44c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1458307633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:27Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec56942c-dc22-45bb-8d26-77b60c78ae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec56942c-dc22-45bb-8d26-77b60c78ae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699a7008-ab72-4537-bfdb-c6714f78dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699a7008-ab72-4537-bfdb-c6714f78dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8', 'volume_name': 'volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cddc621-b874-44c6-94e4-4efc903ead65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cddc621-b874-44c6-94e4-4efc903ead65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7208e160-8629-4dfe-9f31-b8a384586bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:26 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Volume 1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8', 'volume_size': 1} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:26 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 1073741824" returned: 0 in 0.580s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:26 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 Apr 09 17:40:26 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:27 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" returned: 0 in 0.446s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740812158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ecaebc-521d-4c6d-b7a1-6497c7e5d119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:25Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Creating volume 79ecaebc-521d-4c6d-b7a1-6497c7e5d119 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:27 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac32dc19-018b-4f11-808e-9e06608087b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50768ace-3ace-459d-a2df-1b130da53f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:27 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 (4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9): created successfully Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50768ace-3ace-459d-a2df-1b130da53f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (a46e322a-fe10-43b6-9021-dd6871d80dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:27 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 1073741824 Apr 09 17:40:27 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:27 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-75e5e035-af51-4125-ab26-ab55959f537f tempest-CreateVolumesFromSnapshotTest-264493962 None] Created volume successfully. Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:27 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 1073741824" returned: 0 in 0.530s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:27 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:27 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 Apr 09 17:40:27 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:28 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119" returned: 0 in 0.526s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.701s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1328710213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:26Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Creating volume 1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:28 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687fa11c-05de-430e-aed4-d1d9315c1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d303d69d-81ab-4d53-952c-2be34da1745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:28 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c 1073741824 Apr 09 17:40:28 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:28 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Volume volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 (79ecaebc-521d-4c6d-b7a1-6497c7e5d119): created successfully Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d303d69d-81ab-4d53-952c-2be34da1745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (facc9b1a-90d4-4f90-9d25-29304eec6b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:28 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cf7c3b05-80f9-4e9a-a342-996eb505df5b tempest-CreateVolumesFromImageTest-358625602 None] Created volume successfully. Apr 09 17:40:28 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:29 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c 1073741824" returned: 0 in 0.607s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:29 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c Apr 09 17:40:29 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:29 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c" returned: 0 in 0.544s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.509s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962924681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5011fc31-55a2-4267-bcd2-5fa09eed3df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:26Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Creating volume 5011fc31-55a2-4267-bcd2-5fa09eed3df1 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:29 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfec5e1-0aca-4b61-bbd9-1241b9471d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:29 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 1073741824 Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e3b7ee-a7e7-46f2-a004-a35f0634c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:29 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:29 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Volume volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c (1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c): created successfully Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e3b7ee-a7e7-46f2-a004-a35f0634c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:29 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (88dcab86-1b46-43c7-89f5-3d939d7710c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:29 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-913d5eeb-8cf0-4869-aa12-424302b8e664 tempest-CreateVolumesFromImageTest-358625602 None] Created volume successfully. Apr 09 17:40:30 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 1073741824" returned: 0 in 0.557s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:30 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 Apr 09 17:40:30 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:30 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.178s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452353376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500d6708-8298-4fd9-9ca7-7bbeefffa164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:26Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Creating volume 500d6708-8298-4fd9-9ca7-7bbeefffa164 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:30 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d282c3-310c-49a8-9e04-4a79bd230758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:30 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 1073741824 Apr 09 17:40:30 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2266863f-0363-4c93-83a3-abb3c7757a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:30 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Volume volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 (5011fc31-55a2-4267-bcd2-5fa09eed3df1): created successfully Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2266863f-0363-4c93-83a3-abb3c7757a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:30 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (173cb683-b63d-44c3-88c5-93888ff686b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:30 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7136d728-de9a-44cb-a779-93e6f725a1b5 tempest-CreateVolumesFromImageTest-358625602 None] Created volume successfully. Apr 09 17:40:31 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 1073741824" returned: 0 in 0.592s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:31 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 Apr 09 17:40:31 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:31 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164" returned: 0 in 0.498s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.191s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1458307633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b2bc0836aa4397ade44940e24cdcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:27Z,use_quota=True,user_id='99ff1cd536d549a99e8a27ce1f875f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Creating volume 1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:31 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50b5278-bd89-4108-a1f9-5f8d403a6060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500d6708-8298-4fd9-9ca7-7bbeefffa164', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:31 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 1073741824 Apr 09 17:40:31 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5688efe7-b186-4fd3-9891-5bc5a034e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:31 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Volume volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 (500d6708-8298-4fd9-9ca7-7bbeefffa164): created successfully Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5688efe7-b186-4fd3-9891-5bc5a034e31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:31 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (718652a4-5657-4a29-b172-7fa4c439f454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:31 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-50c524fc-a569-48c0-8d31-16bd08ac6271 tempest-CreateVolumesFromImageTest-358625602 None] Created volume successfully. Apr 09 17:40:32 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 1073741824" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:32 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 Apr 09 17:40:32 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:32 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8" returned: 0 in 0.450s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.363s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Creating offline snapshot 8afd8ce2-32ff-49a3-846f-2898aa7f8c7a of volume b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7208e160-8629-4dfe-9f31-b8a384586bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f85918d-bb76-4ab2-8530-4821732a2938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ab96f-60f0-4d72-80e3-a3309d1a99ca]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:32 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Volume volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 (1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8): created successfully Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f85918d-bb76-4ab2-8530-4821732a2938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:32 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Flow 'volume_create_manager' (eece2573-1b94-4311-a77f-46f497d0b6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:32 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a3bc3838-c371-4123-a331-543b69206c1c tempest-CreateVolumesFromImageTest-358625602 None] Created volume successfully. Apr 09 17:40:32 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:32 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-quobyte-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[386149ad-f354-4fa8-8d1c-aa5d3d44f73b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:33 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 Apr 09 17:40:33 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:33 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.548s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:33 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a 1G Apr 09 17:40:33 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:33 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8" returned: 0 in 0.557s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:33 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8 Apr 09 17:40:33 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:33 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a 1G" returned: 0 in 0.519s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:33 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:33 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a Apr 09 17:40:33 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:34 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8" returned: 0 in 0.449s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8" released by "delete_volume" :: held 1.030s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Created reservations ['7edc0758-3c82-4cd5-b607-7ca20e566838', '2453f3c6-d303-46c2-a439-4236c2907101', '9970c28d-aebe-4bf5-b9de-c8ebbdf1218e', '1fc64504-6a17-47f8-8c93-a9d8407f8e00'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:34 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:34 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:34 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:34 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a is being set with open permissions: ugo+rw Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:34 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a Apr 09 17:40:34 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:34 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.429s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:34 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Deleted volume successfully. Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-856a6785-3cf0-4d1c-8165-9f7fd64ab23e tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-1a9fc6fe-baf3-4976-b75e-a88eb08b7ab8-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:34 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:34 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:34 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info Apr 09 17:40:34 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-500d6708-8298-4fd9-9ca7-7bbeefffa164-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:35 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-500d6708-8298-4fd9-9ca7-7bbeefffa164-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info" returned: 0 in 0.468s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:35 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info is being set with open permissions: ugo+rw Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:35 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info Apr 09 17:40:35 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-quobyte-500d6708-8298-4fd9-9ca7-7bbeefffa164" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-500d6708-8298-4fd9-9ca7-7bbeefffa164" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f4218-b09c-42bd-9136-904f5580fe80]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:35 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 Apr 09 17:40:35 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:35 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.info" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.089s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.329s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:35 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-489d2fea-a9ae-4c6f-bb8e-a9d80fd424b7 tempest-VolumeDependencyTests-964238354 None] Create snapshot completed successfully Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating offline snapshot 663486fc-170f-4b38-860a-3ec48bb05de8 of volume 4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4639a03-409d-46f0-b5c7-bf8b0f9052ea]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:35 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:36 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164" returned: 0 in 0.597s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:36 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 Apr 09 17:40:36 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:36 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164 Apr 09 17:40:36 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:36 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-500d6708-8298-4fd9-9ca7-7bbeefffa164" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-500d6708-8298-4fd9-9ca7-7bbeefffa164" released by "delete_volume" :: held 1.091s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:36 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Created reservations ['12a9203d-d8dd-4912-9119-bef0447df721', 'cb7df67f-8fc4-46e1-86c5-99616028d0cd', '444c611e-f5c8-4b30-9199-bedf8a53687a', '09cd0895-3ea7-4a18-9695-2a13369f70fd'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" returned: 0 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:36 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 1G Apr 09 17:40:36 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:36 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:36 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:36 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:37 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (62203afc-665a-4533-873c-2a549069149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d0984-3e2b-4e39-8b2f-03c03b7a1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.581s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d0984-3e2b-4e39-8b2f-03c03b7a1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-570001404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a4c1b8-b375-4698-9539-75b5d9350dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966e097529b46d8b60791d7e1a50033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8afd8ce2-32ff-49a3-846f-2898aa7f8c7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:37Z,use_quota=True,user_id='c20f49120c974c41ba8ce2afd7dac036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9768d6a5-1c08-4f54-ae1e-54a42c84eda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:37 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9768d6a5-1c08-4f54-ae1e-54a42c84eda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3091ae3b-7150-413d-8754-1ca7910a2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3091ae3b-7150-413d-8754-1ca7910a2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e4a4c1b8-b375-4698-9539-75b5d9350dd6', 'volume_name': 'volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6', 'volume_size': 1, 'snapshot_id': '8afd8ce2-32ff-49a3-846f-2898aa7f8c7a'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f9892-7806-431f-871f-22da8c9fcaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f9892-7806-431f-871f-22da8c9fcaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac57c704-06ca-460e-9b79-1025654cce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:37 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Volume e4a4c1b8-b375-4698-9539-75b5d9350dd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6', 'volume_size': 1, 'snapshot_id': '8afd8ce2-32ff-49a3-846f-2898aa7f8c7a'} Apr 09 17:40:37 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Deleted volume successfully. Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 1G" returned: 0 in 0.693s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3180b7c9-75bf-4568-b194-8f48cf41d440 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-500d6708-8298-4fd9-9ca7-7bbeefffa164-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:37 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 Apr 09 17:40:37 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-5011fc31-55a2-4267-bcd2-5fa09eed3df1-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-5011fc31-55a2-4267-bcd2-5fa09eed3df1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-quobyte-5011fc31-55a2-4267-bcd2-5fa09eed3df1" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-5011fc31-55a2-4267-bcd2-5fa09eed3df1" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d95d068-ce82-4b1e-afa9-e5adba5a76f4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:37 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8" returned: 0 in 0.443s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:37 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 is being set with open permissions: ugo+rw Apr 09 17:40:37 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:37 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 Apr 09 17:40:37 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:37 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 Apr 09 17:40:37 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:38 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:38 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1 Apr 09 17:40:38 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:38 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:38 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info Apr 09 17:40:38 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:38 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-5011fc31-55a2-4267-bcd2-5fa09eed3df1" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-5011fc31-55a2-4267-bcd2-5fa09eed3df1" released by "delete_volume" :: held 0.974s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Created reservations ['a13b48b6-1184-48a8-b073-d6ead8cfd88f', 'fc85f00b-d600-403e-981f-88158b7c00a1', 'b32f9ab0-e69c-44ee-b2b5-ed27c4d7704e', '07ef1ffe-d175-4db2-9ee5-078873887792'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:38 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:38 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:38 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info" returned: 0 in 0.647s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:38 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info is being set with open permissions: ugo+rw Apr 09 17:40:38 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:38 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info Apr 09 17:40:38 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:39 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.478s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Deleted volume successfully. Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ddffd84f-dd4a-48ea-bf3b-1531ade07ee0 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-5011fc31-55a2-4267-bcd2-5fa09eed3df1-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Flow 'volume_create_manager' (df198107-41f4-4b04-8e2b-7668f01407bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a52b05-fa07-4dee-8d25-43681eb2aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a52b05-fa07-4dee-8d25-43681eb2aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1726955566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8983f2-1844-4298-9872-9fe2843f6b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3042be55627144ce8b8554ef4450ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:39Z,use_quota=True,user_id='25c33a5a998c4806ac26c7fdea257440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389bea56-6233-40e6-8be5-511d4bf31e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389bea56-6233-40e6-8be5-511d4bf31e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4989a485-13b0-432a-9380-d808147b03f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4989a485-13b0-432a-9380-d808147b03f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8983f2-1844-4298-9872-9fe2843f6b49', 'volume_name': 'volume-0f8983f2-1844-4298-9872-9fe2843f6b49', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:39 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd763ec8-d5f7-4232-b8cd-7b40adfdcacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd763ec8-d5f7-4232-b8cd-7b40adfdcacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff032be8-157c-475d-b8f9-b07fa817df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:39 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Volume 0f8983f2-1844-4298-9872-9fe2843f6b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8983f2-1844-4298-9872-9fe2843f6b49', 'volume_size': 1} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.info" returned: 0 in 0.433s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.372s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.020s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a-e4a4c1b8-b375-4698-9539-75b5d9350dd6" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a-e4a4c1b8-b375-4698-9539-75b5d9350dd6" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Creating volume e4a4c1b8-b375-4698-9539-75b5d9350dd6 from snapshot 8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-e4a4c1b8-b375-4698-9539-75b5d9350dd6" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:39 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b77419b5-97ad-46c3-bc1c-b66574f77cca tempest-CreateVolumesFromSnapshotTest-264493962 None] Create snapshot completed successfully Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-e4a4c1b8-b375-4698-9539-75b5d9350dd6" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] snapshot: 8afd8ce2-32ff-49a3-846f-2898aa7f8c7a, volume: e4a4c1b8-b375-4698-9539-75b5d9350dd6, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd21b2-9295-4852-995e-424881980c59]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:39 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a Apr 09 17:40:39 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-quobyte-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c" acquired by "delete_volume" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd56469-86b7-457e-9924-96609354fe6d]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:39 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" returned: 0 in 0.467s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2af41e4-336b-4501-bb0f-36c3e1148307]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:39 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:39 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c Apr 09 17:40:39 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:39 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:39 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (cc4c2112-2772-4f93-89f4-46268b596506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b16fdcc-83d9-474a-a6c3-e371bb3d777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b16fdcc-83d9-474a-a6c3-e371bb3d777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273900685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75cec52-f9a7-4f28-b216-e9c1002147ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:40Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cae0bb-bf1a-41c7-acc7-60ed6aa89e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cae0bb-bf1a-41c7-acc7-60ed6aa89e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107ac0a6-5736-4c01-bb78-d8553c4d5a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107ac0a6-5736-4c01-bb78-d8553c4d5a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75cec52-f9a7-4f28-b216-e9c1002147ea', 'volume_name': 'volume-d75cec52-f9a7-4f28-b216-e9c1002147ea', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c005a4bc-ab0a-4d39-b4db-ae6d7ddd236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c005a4bc-ab0a-4d39-b4db-ae6d7ddd236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8644a0-2057-4b86-becb-d453d3da2c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume d75cec52-f9a7-4f28-b216-e9c1002147ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75cec52-f9a7-4f28-b216-e9c1002147ea', 'volume_size': 1} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:40 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c" returned: 0 in 0.504s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:40 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c Apr 09 17:40:40 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (330b6079-061e-4149-862e-a57ca54abb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631b8116-e2fc-4e80-872c-6562dced529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631b8116-e2fc-4e80-872c-6562dced529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611016423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7282491a-75d5-4611-a195-c8fc0fa6143c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:40Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c430342e-9470-48da-820b-3dbb03fbb706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c430342e-9470-48da-820b-3dbb03fbb706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed97c4-a223-4e7b-b213-4b9f8e0eeb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed97c4-a223-4e7b-b213-4b9f8e0eeb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7282491a-75d5-4611-a195-c8fc0fa6143c', 'volume_name': 'volume-7282491a-75d5-4611-a195-c8fc0fa6143c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160dd118-2c8a-47b8-b65c-0512df2b8799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160dd118-2c8a-47b8-b65c-0512df2b8799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a138a4c7-05df-4390-8d62-92c8d897982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume 7282491a-75d5-4611-a195-c8fc0fa6143c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7282491a-75d5-4611-a195-c8fc0fa6143c', 'volume_size': 1} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.642s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:40 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 Apr 09 17:40:40 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (40f37aa3-5f30-4758-a348-1679e0b79cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5376d5-2f46-4332-9588-c34394bebef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5376d5-2f46-4332-9588-c34394bebef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028407229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adb7855-8336-4b09-8a2b-284759c4f4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:40Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd44795-0661-4703-92f0-417388dc7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd44795-0661-4703-92f0-417388dc7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921d3e1a-879d-4046-8d43-cb7f90c466ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921d3e1a-879d-4046-8d43-cb7f90c466ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3adb7855-8336-4b09-8a2b-284759c4f4a1', 'volume_name': 'volume-3adb7855-8336-4b09-8a2b-284759c4f4a1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7437c8b8-0755-4627-8515-155f0e565108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7437c8b8-0755-4627-8515-155f0e565108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4e4676-619f-42d4-aa9e-03551cf975a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume 3adb7855-8336-4b09-8a2b-284759c4f4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3adb7855-8336-4b09-8a2b-284759c4f4a1', 'volume_size': 1} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (3ece3464-d432-4318-8190-ac6f8b47f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84384f6a-4619-4731-9427-5162242dcb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84384f6a-4619-4731-9427-5162242dcb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649105688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cdf60d-028a-4c80-ab07-4095815a9886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:41Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78437ded-da1b-40b1-aae8-d79f399242b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78437ded-da1b-40b1-aae8-d79f399242b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba5811e-d736-43ec-9f45-f1fd78db3463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba5811e-d736-43ec-9f45-f1fd78db3463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cdf60d-028a-4c80-ab07-4095815a9886', 'volume_name': 'volume-48cdf60d-028a-4c80-ab07-4095815a9886', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7fbe24-5959-4152-b16f-ab10a1e6b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7fbe24-5959-4152-b16f-ab10a1e6b434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2f54db-c188-4e27-9146-83fa042a1393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume 48cdf60d-028a-4c80-ab07-4095815a9886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cdf60d-028a-4c80-ab07-4095815a9886', 'volume_size': 1} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c" released by "delete_volume" :: held 1.016s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Created reservations ['43216d3b-0ff8-4149-9ff4-53b2b346c16e', '4296dfea-5df3-469d-852c-5cda77d1d0e9', '77bc0da8-edd0-4730-ac67-c93348fe69f2', '65e3cd45-27ed-4fc8-a9df-716bfe58c777'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:40 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:40 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (62122bad-cb8c-4cb3-8a5f-bdb2c487d448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942bb836-d233-45f1-ab1b-dbbb09c0f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942bb836-d233-45f1-ab1b-dbbb09c0f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-954207382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ef5da-cb96-40fd-8476-9c7f3116994f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:41Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809648f3-7773-4b74-8c40-57b14175fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809648f3-7773-4b74-8c40-57b14175fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff45cb1-65f6-4ee3-928e-b88f90610079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff45cb1-65f6-4ee3-928e-b88f90610079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1ef5da-cb96-40fd-8476-9c7f3116994f', 'volume_name': 'volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba12f662-7e35-40c7-b764-89a1e776097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba12f662-7e35-40c7-b764-89a1e776097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e378b0-2626-428b-afc3-0ada03b7d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:40 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume 0e1ef5da-cb96-40fd-8476-9c7f3116994f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f', 'volume_size': 1} Apr 09 17:40:40 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:41 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:41 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 1.027s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:41 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:41 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Deleted volume successfully. Apr 09 17:40:41 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-bab20bff-0680-4800-b23a-a88457e2eb4b tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-1bd5ab5b-fbd5-4aa4-9011-6bdd127ba56c-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-79ecaebc-521d-4c6d-b7a1-6497c7e5d119-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-79ecaebc-521d-4c6d-b7a1-6497c7e5d119-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "cinder-quobyte-79ecaebc-521d-4c6d-b7a1-6497c7e5d119" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-79ecaebc-521d-4c6d-b7a1-6497c7e5d119" acquired by "delete_volume" :: waited 0.041s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b623d8-b961-443a-bd45-269587937b04]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:42 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 Apr 09 17:40:42 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:42 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6" returned: 0 in 2.240s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae743ca-a062-408c-bdb5-f13b47e3b607]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:42 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:42 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:42 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119" returned: 0 in 0.704s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:42 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:42 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119 Apr 09 17:40:42 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:43 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-79ecaebc-521d-4c6d-b7a1-6497c7e5d119" returned: 0 in 0.405s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-quobyte-79ecaebc-521d-4c6d-b7a1-6497c7e5d119" released by "delete_volume" :: held 1.149s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Created reservations ['f8c6c8d6-c28e-408d-8ed6-6d4640704a61', 'c58e5479-4965-41cf-9c54-e082a178ea9b', '1fe61706-c125-427f-bed8-fcaf5434296f', '79e69253-62fb-4792-bd99-b8711daf0769'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:43 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.600s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:40:43 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Converted 1024.00 MB image at 456.97 MB/s Apr 09 17:40:43 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 is being set with open permissions: ugo+rw Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:43 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 Apr 09 17:40:43 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:43 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:43 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:43 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6" returned: 0 in 0.416s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-e4a4c1b8-b375-4698-9539-75b5d9350dd6" released by "_copy_volume_from_snapshot" :: held 4.414s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a-e4a4c1b8-b375-4698-9539-75b5d9350dd6" released by "_create_volume_from_snapshot" :: held 4.433s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.453s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.467s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1726955566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8983f2-1844-4298-9872-9fe2843f6b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3042be55627144ce8b8554ef4450ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:39Z,use_quota=True,user_id='25c33a5a998c4806ac26c7fdea257440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Creating volume 0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:43 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:43 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 1073741824 Apr 09 17:40:43 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:43 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac57c704-06ca-460e-9b79-1025654cce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6', 'volume_size': 1, 'snapshot_id': '8afd8ce2-32ff-49a3-846f-2898aa7f8c7a'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d4fb66-6128-4b2a-a175-0506d5b9f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.437s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Deleted volume successfully. Apr 09 17:40:43 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Volume volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 (e4a4c1b8-b375-4698-9539-75b5d9350dd6): created successfully Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d4fb66-6128-4b2a-a175-0506d5b9f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (62203afc-665a-4533-873c-2a549069149d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:43 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-074db2e3-b3d2-4f46-b737-d746bf21b7c8 tempest-CreateVolumesFromImageTest-358625602 None] Lock "cinder-79ecaebc-521d-4c6d-b7a1-6497c7e5d119-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:43 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-f33c42db-c093-43cc-a65d-e9d548dc112f tempest-VolumeDependencyTests-964238354 None] Created volume successfully. Apr 09 17:40:44 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 1073741824" returned: 0 in 0.483s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:44 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:40:44 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:44 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.490s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.567s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273900685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75cec52-f9a7-4f28-b216-e9c1002147ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:40Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating volume d75cec52-f9a7-4f28-b216-e9c1002147ea {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:44 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:44 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea 1073741824 Apr 09 17:40:44 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff032be8-157c-475d-b8f9-b07fa817df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8983f2-1844-4298-9872-9fe2843f6b49', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4817f24-80df-42d7-a2e7-b49ca121a256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:44 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Volume volume-0f8983f2-1844-4298-9872-9fe2843f6b49 (0f8983f2-1844-4298-9872-9fe2843f6b49): created successfully Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4817f24-80df-42d7-a2e7-b49ca121a256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Flow 'volume_create_manager' (df198107-41f4-4b04-8e2b-7668f01407bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:44 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-0121f18d-98f6-474a-9b22-cbef8c1f12b7 tempest-SnapshotDependencyTests-173858327 None] Created volume successfully. Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Deleting offline snapshot 8afd8ce2-32ff-49a3-846f-2898aa7f8c7a of volume b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] snapshot_file for this snap is: volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7ae49c-0000-41fb-a196-d882ddd82d72]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:44 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:44 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a Apr 09 17:40:44 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:45 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea 1073741824" returned: 0 in 0.585s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:45 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea Apr 09 17:40:45 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:45 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" returned: 0 in 0.566s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e9bf6-c6d2-43a4-9422-8f04ab7214b2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:45 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:45 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:45 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea" returned: 0 in 0.505s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.426s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611016423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7282491a-75d5-4611-a195-c8fc0fa6143c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:40Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating volume 7282491a-75d5-4611-a195-c8fc0fa6143c {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:45 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8644a0-2057-4b86-becb-d453d3da2c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75cec52-f9a7-4f28-b216-e9c1002147ea', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:45 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c 1073741824 Apr 09 17:40:45 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53218b41-75a9-4990-a806-2348fadd47d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:45 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume volume-d75cec52-f9a7-4f28-b216-e9c1002147ea (d75cec52-f9a7-4f28-b216-e9c1002147ea): created successfully Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53218b41-75a9-4990-a806-2348fadd47d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (cc4c2112-2772-4f93-89f4-46268b596506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:45 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7e3763eb-8673-4cd9-8a27-7a1bbf3354c2 tempest-CreateVolumesFromSnapshotTest-264493962 None] Created volume successfully. Apr 09 17:40:45 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (3b064f31-f6c9-4aaf-9097-a9b2dcdb9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919f77b3-cb3e-4a22-a29b-06ac3d5a4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919f77b3-cb3e-4a22-a29b-06ac3d5a4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1307351201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f20a2d-a2ca-41fb-b734-1d01ab533ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:46Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734e354-a06c-4957-88bb-dafa7194b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734e354-a06c-4957-88bb-dafa7194b65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f189fe-0260-4960-85ba-bd5780cb7dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f189fe-0260-4960-85ba-bd5780cb7dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f20a2d-a2ca-41fb-b734-1d01ab533ef5', 'volume_name': 'volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53204550-77e0-423c-aa7b-3bf93f2db5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53204550-77e0-423c-aa7b-3bf93f2db5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6d647f-058b-4cde-a022-92219eb07847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:46 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume 70f20a2d-a2ca-41fb-b734-1d01ab533ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5', 'volume_size': 1} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:46 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.647s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:46 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a Apr 09 17:40:46 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:46 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c 1073741824" returned: 0 in 0.521s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:46 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c Apr 09 17:40:46 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:46 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:46 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a Apr 09 17:40:46 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:46 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c" returned: 0 in 0.427s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.271s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028407229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adb7855-8336-4b09-8a2b-284759c4f4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:40Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating volume 3adb7855-8336-4b09-8a2b-284759c4f4a1 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:46 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:46 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 1073741824 Apr 09 17:40:46 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a138a4c7-05df-4390-8d62-92c8d897982d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7282491a-75d5-4611-a195-c8fc0fa6143c', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bc39dc-46e6-4714-abfc-732956745214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:46 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume volume-7282491a-75d5-4611-a195-c8fc0fa6143c (7282491a-75d5-4611-a195-c8fc0fa6143c): created successfully Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0bc39dc-46e6-4714-abfc-732956745214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:46 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (330b6079-061e-4149-862e-a57ca54abb44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:46 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-04bc8f5e-d1e8-4d50-ade0-7e7dff27194b tempest-CreateVolumesFromSnapshotTest-264493962 None] Created volume successfully. Apr 09 17:40:47 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9.8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" returned: 0 in 0.417s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a" released by "_delete_snapshot" :: held 2.147s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" released by "delete_snapshot" :: held 2.158s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Created reservations ['7b71020e-5142-455e-be12-5b69f30f9a36', '8b2352a0-210b-476c-be38-383ed7dbec86', '7b7eb70b-3bb8-44a4-9391-36f25ddcb108', '6aabcd2b-4102-44cf-8a70-a4979c3ac4da'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Delete snapshot completed successfully. Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-02e6978c-322c-4e56-943c-91e6d456cb50 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-8afd8ce2-32ff-49a3-846f-2898aa7f8c7a-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:47 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 1073741824" returned: 0 in 0.519s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:47 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 Apr 09 17:40:47 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:47 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1" returned: 0 in 0.391s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.036s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649105688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cdf60d-028a-4c80-ab07-4095815a9886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:41Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating volume 48cdf60d-028a-4c80-ab07-4095815a9886 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:47 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4e4676-619f-42d4-aa9e-03551cf975a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3adb7855-8336-4b09-8a2b-284759c4f4a1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:47 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 1073741824 Apr 09 17:40:47 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6816b76c-9e2a-4dc3-8cd1-45ec1585fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:47 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 (3adb7855-8336-4b09-8a2b-284759c4f4a1): created successfully Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6816b76c-9e2a-4dc3-8cd1-45ec1585fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (40f37aa3-5f30-4758-a348-1679e0b79cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:47 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-27277d5d-b747-4ce3-aff5-f8e2e6cba944 tempest-CreateVolumesFromSnapshotTest-264493962 None] Created volume successfully. Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-b0b08067-50b8-44e0-9f09-f80cfdffcfe9-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:47 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-b0b08067-50b8-44e0-9f09-f80cfdffcfe9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f8009-59be-4ff4-a57b-577203312d39]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:48 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:48 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:48 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 1073741824" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:48 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 Apr 09 17:40:48 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:48 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:48 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9 Apr 09 17:40:48 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:48 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886" returned: 0 in 0.403s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.782s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-954207382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ef5da-cb96-40fd-8476-9c7f3116994f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c484f57b8bd94c8a9bfdc26e972ecc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:41Z,use_quota=True,user_id='99e46a5a5f43428ab24d58b288b977f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Creating volume 0e1ef5da-cb96-40fd-8476-9c7f3116994f {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:48 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2f54db-c188-4e27-9146-83fa042a1393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cdf60d-028a-4c80-ab07-4095815a9886', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34646af9-a113-4940-9540-b9ddc5d99a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:48 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f 1073741824 Apr 09 17:40:48 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:48 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume volume-48cdf60d-028a-4c80-ab07-4095815a9886 (48cdf60d-028a-4c80-ab07-4095815a9886): created successfully Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34646af9-a113-4940-9540-b9ddc5d99a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (3ece3464-d432-4318-8190-ac6f8b47f795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:48 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-cc08bb00-b700-4c4a-b60b-0408cb84f87f tempest-CreateVolumesFromSnapshotTest-264493962 None] Created volume successfully. Apr 09 17:40:48 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" returned: 0 in 0.407s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-b0b08067-50b8-44e0-9f09-f80cfdffcfe9" released by "delete_volume" :: held 0.926s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:48 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Created reservations ['804a8328-7e5e-4350-8079-14b967ab6ef5', 'cf136802-5208-4965-93e0-6087bc4ef9b6', 'cb49b679-e015-44e6-ad40-0ba02f24e07e', '1b6196a9-4100-417d-b6e8-e82b2c9f37b7'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:49 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:49 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:49 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f 1073741824" returned: 0 in 0.566s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (0b8e53ee-eac8-4040-9183-841b723d1897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1365c8b1-ae4f-4f20-a7fe-8523c539c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1365c8b1-ae4f-4f20-a7fe-8523c539c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934309230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e30b7cd-802b-4116-b271-60d7657f7e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966e097529b46d8b60791d7e1a50033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:49Z,use_quota=True,user_id='c20f49120c974c41ba8ce2afd7dac036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a7b2c9-ad09-4803-a3c8-3908c70aebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a7b2c9-ad09-4803-a3c8-3908c70aebb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a690be-df4f-467e-baf6-35b4fb025e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a690be-df4f-467e-baf6-35b4fb025e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e30b7cd-802b-4116-b271-60d7657f7e29', 'volume_name': 'volume-7e30b7cd-802b-4116-b271-60d7657f7e29', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a70187d-87f6-40d5-b450-3d9ac06f7589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a70187d-87f6-40d5-b450-3d9ac06f7589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c402213-4246-4102-bed3-96a967477b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:49 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Volume 7e30b7cd-802b-4116-b271-60d7657f7e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e30b7cd-802b-4116-b271-60d7657f7e29', 'volume_size': 1} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:49 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f Apr 09 17:40:49 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:49 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.505s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Deleted volume successfully. Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-edcf49bb-57e4-4c3b-8c53-5384a81dd477 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-b0b08067-50b8-44e0-9f09-f80cfdffcfe9-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:49 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f" returned: 0 in 0.406s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.866s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Creating offline snapshot 106b884a-1de7-439d-b4b0-3396bf95e6f8 of volume 0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e378b0-2626-428b-afc3-0ada03b7d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e973ac1-8e84-42bd-b46e-4f1cc756a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e18b601-693a-4339-8fa0-8349dd0412a6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:49 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Volume volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f (0e1ef5da-cb96-40fd-8476-9c7f3116994f): created successfully Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e973ac1-8e84-42bd-b46e-4f1cc756a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:49 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Flow 'volume_create_manager' (62122bad-cb8c-4cb3-8a5f-bdb2c487d448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:49 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-7ab05e89-7746-4202-936c-a037eebc8037 tempest-CreateVolumesFromSnapshotTest-264493962 None] Created volume successfully. Apr 09 17:40:49 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:40:49 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:50 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.483s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:50 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 1G Apr 09 17:40:50 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-0e1ef5da-cb96-40fd-8476-9c7f3116994f-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-0e1ef5da-cb96-40fd-8476-9c7f3116994f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-0e1ef5da-cb96-40fd-8476-9c7f3116994f" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-0e1ef5da-cb96-40fd-8476-9c7f3116994f" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f5305e-d0a0-45c8-a116-d090e5cb9040]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:50 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f Apr 09 17:40:50 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:50 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 1G" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:50 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8983f2-1844-4298-9872-9fe2843f6b49 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:50 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8983f2-1844-4298-9872-9fe2843f6b49 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 Apr 09 17:40:50 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:51 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f" returned: 0 in 0.489s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:51 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f Apr 09 17:40:51 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:51 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8983f2-1844-4298-9872-9fe2843f6b49 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8" returned: 0 in 0.436s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:51 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 is being set with open permissions: ugo+rw Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:51 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 Apr 09 17:40:51 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:51 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0e1ef5da-cb96-40fd-8476-9c7f3116994f" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-0e1ef5da-cb96-40fd-8476-9c7f3116994f" released by "delete_volume" :: held 0.981s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['a1097884-4cd7-447e-87ac-425e11b88915', '2f28b3ba-637c-4e66-ab9c-402ae9d375a1', '403a16b4-7274-4ecb-bb03-130e3f3bfcb8', '25d905b1-2e7a-49a9-ad13-be5c5fd9c4ba'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:51 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:51 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-48cdf60d-028a-4c80-ab07-4095815a9886-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:51 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-48cdf60d-028a-4c80-ab07-4095815a9886-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8" returned: 0 in 0.475s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-48cdf60d-028a-4c80-ab07-4095815a9886" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-48cdf60d-028a-4c80-ab07-4095815a9886" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:51 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info Apr 09 17:40:51 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0551fd14-028a-462f-bb93-6162601111fb]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:51 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:51 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 Apr 09 17:40:51 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:52 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:52 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleted volume successfully. Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-725e3308-81fb-4dcb-8a78-aebaa1aa508f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-0e1ef5da-cb96-40fd-8476-9c7f3116994f-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:52 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info" returned: 0 in 0.468s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:52 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info is being set with open permissions: ugo+rw Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:52 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info Apr 09 17:40:52 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:52 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:52 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886 Apr 09 17:40:52 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:52 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.info" returned: 0 in 0.427s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.561s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1307351201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f20a2d-a2ca-41fb-b734-1d01ab533ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:46Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Creating volume 70f20a2d-a2ca-41fb-b734-1d01ab533ef5 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:52 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:52 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-36a7428c-d879-45cb-ba35-64e89bb7c987 tempest-SnapshotDependencyTests-173858327 None] Create snapshot completed successfully Apr 09 17:40:52 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 1073741824 Apr 09 17:40:52 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:52 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-48cdf60d-028a-4c80-ab07-4095815a9886" returned: 0 in 0.430s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-48cdf60d-028a-4c80-ab07-4095815a9886" released by "delete_volume" :: held 0.960s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['59df00aa-c31a-4a4d-b0e4-7a649a1093a2', 'b3dbb206-4099-42fe-b803-22b1cbe2eadb', 'f84d9883-e3fa-4f15-9992-e7be0afcbdf7', 'ee3eac45-c810-4217-b3da-8c7a104a6233'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:52 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:52 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-3adb7855-8336-4b09-8a2b-284759c4f4a1-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-3adb7855-8336-4b09-8a2b-284759c4f4a1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-3adb7855-8336-4b09-8a2b-284759c4f4a1" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-3adb7855-8336-4b09-8a2b-284759c4f4a1" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f81fa-3864-41ff-882e-c1b5ac05715e]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:52 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:52 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 Apr 09 17:40:52 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:53 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 1073741824" returned: 0 in 0.607s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:53 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:53 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.568s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:53 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleted volume successfully. Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3642d9e3-9348-47f7-9b77-89e16272fcf9 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-48cdf60d-028a-4c80-ab07-4095815a9886-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:53 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1" returned: 0 in 0.629s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:53 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1 Apr 09 17:40:53 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Flow 'volume_create_manager' (5506e213-1eec-4beb-8d6c-52cced0fc492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf59476-7dfd-47e4-848f-c2a316ac0317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf59476-7dfd-47e4-848f-c2a316ac0317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856980eb-cad8-4752-a3c5-e7597e887cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3042be55627144ce8b8554ef4450ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=106b884a-1de7-439d-b4b0-3396bf95e6f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:54Z,use_quota=True,user_id='25c33a5a998c4806ac26c7fdea257440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15027a5a-38f2-449b-a032-9c1bfe91ad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15027a5a-38f2-449b-a032-9c1bfe91ad9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ea9d7d-9ff2-48c4-955b-089865df5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ea9d7d-9ff2-48c4-955b-089865df5a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '856980eb-cad8-4752-a3c5-e7597e887cfb', 'volume_name': 'volume-856980eb-cad8-4752-a3c5-e7597e887cfb', 'volume_size': 1, 'snapshot_id': '106b884a-1de7-439d-b4b0-3396bf95e6f8'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532bdbdb-44bc-4540-932a-21c2bbb7edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532bdbdb-44bc-4540-932a-21c2bbb7edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be701905-7b83-4d90-ab67-6a0278a269e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:53 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Volume 856980eb-cad8-4752-a3c5-e7597e887cfb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-856980eb-cad8-4752-a3c5-e7597e887cfb', 'volume_size': 1, 'snapshot_id': '106b884a-1de7-439d-b4b0-3396bf95e6f8'} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:53 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5" returned: 0 in 0.470s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.392s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934309230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e30b7cd-802b-4116-b271-60d7657f7e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966e097529b46d8b60791d7e1a50033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:49Z,use_quota=True,user_id='c20f49120c974c41ba8ce2afd7dac036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Creating volume 7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:53 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6d647f-058b-4cde-a022-92219eb07847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:53 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 1073741824 Apr 09 17:40:53 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d683ca8c-107d-4650-a8ef-5a7538604acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:53 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 (70f20a2d-a2ca-41fb-b734-1d01ab533ef5): created successfully Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d683ca8c-107d-4650-a8ef-5a7538604acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:53 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (3b064f31-f6c9-4aaf-9097-a9b2dcdb9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:53 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-2fa9a987-ee42-4ad9-9152-a142936669ed tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created volume successfully. Apr 09 17:40:53 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-3adb7855-8336-4b09-8a2b-284759c4f4a1" returned: 0 in 0.462s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-3adb7855-8336-4b09-8a2b-284759c4f4a1" released by "delete_volume" :: held 1.123s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['4f66f597-81c2-442b-af9f-7d4d1c943555', 'b5c2daf6-50c1-433e-a0c5-9858e4e44290', '650ae781-53b3-49e7-9107-daacb335e455', '22117be7-7206-4596-ac5e-58caeae5b90a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:54 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:54 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:54 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 1073741824" returned: 0 in 0.476s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:54 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:40:54 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:54 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleted volume successfully. Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-785b0fe9-9158-40ea-8708-ef4d9a243527 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-3adb7855-8336-4b09-8a2b-284759c4f4a1-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:54 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.442s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.085s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-quobyte-106b884a-1de7-439d-b4b0-3396bf95e6f8-856980eb-cad8-4752-a3c5-e7597e887cfb" by "_create_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c402213-4246-4102-bed3-96a967477b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e30b7cd-802b-4116-b271-60d7657f7e29', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a56daad-1c47-4fe9-ac4c-cd2f295fe6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-106b884a-1de7-439d-b4b0-3396bf95e6f8-856980eb-cad8-4752-a3c5-e7597e887cfb" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Creating volume 856980eb-cad8-4752-a3c5-e7597e887cfb from snapshot 106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-quobyte-856980eb-cad8-4752-a3c5-e7597e887cfb" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Volume volume-7e30b7cd-802b-4116-b271-60d7657f7e29 (7e30b7cd-802b-4116-b271-60d7657f7e29): created successfully Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a56daad-1c47-4fe9-ac4c-cd2f295fe6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (0b8e53ee-eac8-4040-9183-841b723d1897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-856980eb-cad8-4752-a3c5-e7597e887cfb" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] snapshot: 106b884a-1de7-439d-b4b0-3396bf95e6f8, volume: 856980eb-cad8-4752-a3c5-e7597e887cfb, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:54 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ec84b7e8-6f6e-4f49-9bd3-0cebbde651cd tempest-VolumeDependencyTests-964238354 None] Created volume successfully. Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca508ee5-e889-4ee8-a994-ff4aeff566e1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (e9dc9f41-9862-494f-a17a-8d21cee990af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888c4322-245c-4770-a623-a8588c9b6838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888c4322-245c-4770-a623-a8588c9b6838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-676820218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b5f01e-30d0-42d8-be93-502f913d8afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e90cded-f11d-4a05-bfdd-74a74e49fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e90cded-f11d-4a05-bfdd-74a74e49fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ad5456-5e5b-4b97-96bc-5fd819942af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ad5456-5e5b-4b97-96bc-5fd819942af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b5f01e-30d0-42d8-be93-502f913d8afa', 'volume_name': 'volume-15b5f01e-30d0-42d8-be93-502f913d8afa', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e791f85b-0f05-470a-991b-d6e2b518d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e791f85b-0f05-470a-991b-d6e2b518d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:54 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 Apr 09 17:40:54 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492da6c5-18de-4d3c-a961-73d297755bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:54 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume 15b5f01e-30d0-42d8-be93-502f913d8afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b5f01e-30d0-42d8-be93-502f913d8afa', 'volume_size': 1} Apr 09 17:40:54 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (7a31aadc-bfaf-45dd-b4cc-2798f25cdb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0df0db0-e384-40e8-b172-fd4e0a2b1070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-7282491a-75d5-4611-a195-c8fc0fa6143c-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0df0db0-e384-40e8-b172-fd4e0a2b1070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830973071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc44ce7e-7bc3-42c0-9f4c-680c19f0390a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aa7907-76b0-483b-8cbc-0ad41853da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aa7907-76b0-483b-8cbc-0ad41853da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b46ba8-bfb2-43c1-b586-36d88caa8fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b46ba8-bfb2-43c1-b586-36d88caa8fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc44ce7e-7bc3-42c0-9f4c-680c19f0390a', 'volume_name': 'volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bfe06f-ba6d-4534-b3ed-bc8954246b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bfe06f-ba6d-4534-b3ed-bc8954246b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ad9ede-0885-48c7-922a-5e7542ede237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume dc44ce7e-7bc3-42c0-9f4c-680c19f0390a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a', 'volume_size': 1} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-7282491a-75d5-4611-a195-c8fc0fa6143c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-7282491a-75d5-4611-a195-c8fc0fa6143c" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-7282491a-75d5-4611-a195-c8fc0fa6143c" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea07ae-74c3-49a6-b6be-8a51440ca8e4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:55 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c Apr 09 17:40:55 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (6679196f-b58e-4d3a-b800-096da0f80677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9265b6-6f31-4da9-a3fd-a6267d4f24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9265b6-6f31-4da9-a3fd-a6267d4f24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814283742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b796d01a-0c4a-4f2b-a3e0-da95f19a8245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c0d83c-c662-42a0-80d5-c85a8d9c4764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c0d83c-c662-42a0-80d5-c85a8d9c4764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd65e8b-a60e-4356-ae76-498e32fde495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd65e8b-a60e-4356-ae76-498e32fde495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b796d01a-0c4a-4f2b-a3e0-da95f19a8245', 'volume_name': 'volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56203507-4948-44d7-bd61-87ffa844358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56203507-4948-44d7-bd61-87ffa844358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d5ce24-b21f-440c-a46e-7f48b3d59511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume b796d01a-0c4a-4f2b-a3e0-da95f19a8245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245', 'volume_size': 1} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:55 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8" returned: 0 in 0.545s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8983f2-1844-4298-9872-9fe2843f6b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfe9522-9307-416c-82c9-6a5f3515a992]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (31498865-e2aa-465b-9b75-d0f8f98ae01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cb8252-cfde-4db3-9fdc-44dc762b9592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cb8252-cfde-4db3-9fdc-44dc762b9592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694528301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd74942-9e49-4a4c-b95a-396bca1ea7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f44a6c-1a18-47cf-9332-bceccae7f5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f44a6c-1a18-47cf-9332-bceccae7f5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beac168-ac27-41c3-bc3a-5c87349969f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beac168-ac27-41c3-bc3a-5c87349969f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd74942-9e49-4a4c-b95a-396bca1ea7de', 'volume_name': 'volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99079685-938b-41d9-bb4c-0c3f831c5028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:40:55 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99079685-938b-41d9-bb4c-0c3f831c5028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3439cfa1-b350-44f1-b27c-8571874d36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume 7cd74942-9e49-4a4c-b95a-396bca1ea7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de', 'volume_size': 1} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (a0486038-86bf-404f-898f-87b4da2d18e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b33ab1-3030-4002-b69c-c767b25e50fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b33ab1-3030-4002-b69c-c767b25e50fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356826527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c7299d-55cb-4097-bd7c-f88e6d7d9d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:56Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bebddb-d397-493d-8d23-378e3119992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bebddb-d397-493d-8d23-378e3119992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042f40cf-9435-4cd3-8b69-e021e21f7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042f40cf-9435-4cd3-8b69-e021e21f7469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c7299d-55cb-4097-bd7c-f88e6d7d9d23', 'volume_name': 'volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f4a79f-303c-4efb-bfa5-097ff0667df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f4a79f-303c-4efb-bfa5-097ff0667df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68002c40-05b3-45ae-aa88-31104dcde4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume 64c7299d-55cb-4097-bd7c-f88e6d7d9d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23', 'volume_size': 1} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:55 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c" returned: 0 in 0.609s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:55 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c Apr 09 17:40:55 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (9b3ee7ed-1214-4158-ab7e-21c32fe10976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8009e99c-e92a-4a27-b5f4-571808df66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8009e99c-e92a-4a27-b5f4-571808df66aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886458451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2dddf8-0473-4e50-9be6-83c72411948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b966e097529b46d8b60791d7e1a50033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7e30b7cd-802b-4116-b271-60d7657f7e29,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:56Z,use_quota=True,user_id='c20f49120c974c41ba8ce2afd7dac036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744efec8-7b5e-49dd-bf53-1a29dfd788fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744efec8-7b5e-49dd-bf53-1a29dfd788fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:55 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2edc6a7-295e-4d55-9144-e196cca00040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2edc6a7-295e-4d55-9144-e196cca00040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6f2dddf8-0473-4e50-9be6-83c72411948a', 'volume_name': 'volume-6f2dddf8-0473-4e50-9be6-83c72411948a', 'volume_size': 1, 'source_volid': '7e30b7cd-802b-4116-b271-60d7657f7e29', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee8422-2179-4e85-904a-2a4a74952a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ee8422-2179-4e85-904a-2a4a74952a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15e1cd9-ff50-4637-b65b-9d4d7e87e9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:56 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Volume 6f2dddf8-0473-4e50-9be6-83c72411948a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6f2dddf8-0473-4e50-9be6-83c72411948a', 'volume_size': 1, 'source_volid': '7e30b7cd-802b-4116-b271-60d7657f7e29', 'source_volstatus': 'available'} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:56 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.624s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:56 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb Apr 09 17:40:56 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:56 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7282491a-75d5-4611-a195-c8fc0fa6143c" returned: 0 in 0.419s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-7282491a-75d5-4611-a195-c8fc0fa6143c" released by "delete_volume" :: held 1.052s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['19bea47a-4f26-473e-a7af-07d395a03acb', '27290c44-2d04-42cb-acd7-5542234f13ec', '8997c2b1-45bb-42d1-bb02-b739d50c213d', 'fa37058c-7bda-46cb-b07b-88343b4877ab'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:56 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:56 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:56 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:57 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.810s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:57 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleted volume successfully. Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-697d3e83-cff5-4ac0-883f-13b756cf663e tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-7282491a-75d5-4611-a195-c8fc0fa6143c-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-d75cec52-f9a7-4f28-b216-e9c1002147ea-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-d75cec52-f9a7-4f28-b216-e9c1002147ea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-d75cec52-f9a7-4f28-b216-e9c1002147ea" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-d75cec52-f9a7-4f28-b216-e9c1002147ea" acquired by "delete_volume" :: waited 0.025s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9b6fef-3507-4922-a76d-d05a0e8b5248]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:57 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:57 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea Apr 09 17:40:57 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:58 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb" returned: 0 in 2.225s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a714788-0ce7-4663-88a8-e4b9536558f1]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:58 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:40:58 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:58 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea" returned: 0 in 0.932s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:58 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea Apr 09 17:40:58 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:58 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-d75cec52-f9a7-4f28-b216-e9c1002147ea" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-d75cec52-f9a7-4f28-b216-e9c1002147ea" released by "delete_volume" :: held 1.404s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['02437f68-7de5-4817-be39-4737d1be6678', '11013c55-5c53-495c-bb22-ec16aa7daa72', '8cdddb53-c075-4db3-bd4b-79935a8f8723', 'dc546b92-6991-482d-82ca-66fb33d3f42d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:58 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.611s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:40:58 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Converted 1024.00 MB image at 460.04 MB/s Apr 09 17:40:58 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb is being set with open permissions: ugo+rw Apr 09 17:40:58 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:58 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:40:58 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:58 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb Apr 09 17:40:58 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:59 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.435s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:40:59 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleted volume successfully. Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da59614a-f66d-4011-84e3-853760250a98 tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-d75cec52-f9a7-4f28-b216-e9c1002147ea-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:59 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb" returned: 0 in 0.454s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-856980eb-cad8-4752-a3c5-e7597e887cfb" released by "_copy_volume_from_snapshot" :: held 4.527s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-106b884a-1de7-439d-b4b0-3396bf95e6f8-856980eb-cad8-4752-a3c5-e7597e887cfb" released by "_create_volume_from_snapshot" :: held 4.567s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.594s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.403s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-676820218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b5f01e-30d0-42d8-be93-502f913d8afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Creating volume 15b5f01e-30d0-42d8-be93-502f913d8afa {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:40:59 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:59 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa 1073741824 Apr 09 17:40:59 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be701905-7b83-4d90-ab67-6a0278a269e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856980eb-cad8-4752-a3c5-e7597e887cfb', 'volume_size': 1, 'snapshot_id': '106b884a-1de7-439d-b4b0-3396bf95e6f8'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1954fec-348c-4526-a227-a32b2fff6a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:40:59 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Volume volume-856980eb-cad8-4752-a3c5-e7597e887cfb (856980eb-cad8-4752-a3c5-e7597e887cfb): created successfully Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1954fec-348c-4526-a227-a32b2fff6a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Flow 'volume_create_manager' (5506e213-1eec-4beb-8d6c-52cced0fc492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:40:59 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4d6225a5-9a48-442e-9a1c-9e0a36a99c29 tempest-SnapshotDependencyTests-173858327 None] Created volume successfully. Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-663486fc-170f-4b38-860a-3ec48bb05de8-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-663486fc-170f-4b38-860a-3ec48bb05de8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-663486fc-170f-4b38-860a-3ec48bb05de8" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-663486fc-170f-4b38-860a-3ec48bb05de8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleting offline snapshot 663486fc-170f-4b38-860a-3ec48bb05de8 of volume 4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] snapshot_file for this snap is: volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9243bd-704f-44e0-b12c-8c4b4f47e92c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:59 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 Apr 09 17:40:59 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:40:59 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa 1073741824" returned: 0 in 0.520s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:40:59 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:40:59 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa Apr 09 17:40:59 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:00 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8" returned: 0 in 0.542s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-106b884a-1de7-439d-b4b0-3396bf95e6f8-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[204cf298-6f95-41be-a8f1-0afe42a1a3aa]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-106b884a-1de7-439d-b4b0-3396bf95e6f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-quobyte-0f8983f2-1844-4298-9872-9fe2843f6b49" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-0f8983f2-1844-4298-9872-9fe2843f6b49" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-quobyte-106b884a-1de7-439d-b4b0-3396bf95e6f8" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-106b884a-1de7-439d-b4b0-3396bf95e6f8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Deleting offline snapshot 106b884a-1de7-439d-b4b0-3396bf95e6f8 of volume 0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] snapshot_file for this snap is: volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec0b317-6e47-45d5-bde8-a35c8d2a57b4]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:00 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 Apr 09 17:41:00 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:00 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 Apr 09 17:41:00 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:00 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa" returned: 0 in 0.472s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.302s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830973071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc44ce7e-7bc3-42c0-9f4c-680c19f0390a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Creating volume dc44ce7e-7bc3-42c0-9f4c-680c19f0390a {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:41:00 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492da6c5-18de-4d3c-a961-73d297755bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b5f01e-30d0-42d8-be93-502f913d8afa', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4b3e12-503f-4f35-ac6a-c62cb7b7bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:00 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a 1073741824 Apr 09 17:41:00 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:00 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume volume-15b5f01e-30d0-42d8-be93-502f913d8afa (15b5f01e-30d0-42d8-be93-502f913d8afa): created successfully Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4b3e12-503f-4f35-ac6a-c62cb7b7bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (e9dc9f41-9862-494f-a17a-8d21cee990af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:00 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5dd1faae-8916-4538-bf0a-30d967187863 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created volume successfully. Apr 09 17:41:00 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" returned: 0 in 0.529s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:00 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8" returned: 0 in 0.493s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8983f2-1844-4298-9872-9fe2843f6b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:41:00 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 Apr 09 17:41:00 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[532a333c-09c5-4436-94fb-c39497653a30]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:00 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:41:00 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:00 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a 1073741824" returned: 0 in 0.479s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:00 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:00 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a Apr 09 17:41:00 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:01 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:01 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8 Apr 09 17:41:01 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:01 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.524s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:01 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 Apr 09 17:41:01 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:01 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a" returned: 0 in 0.481s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.068s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814283742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b796d01a-0c4a-4f2b-a3e0-da95f19a8245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Creating volume b796d01a-0c4a-4f2b-a3e0-da95f19a8245 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:41:01 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ad9ede-0885-48c7-922a-5e7542ede237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47149c1c-4241-44ca-91a7-c490b449f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:01 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 1073741824 Apr 09 17:41:01 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:01 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a (dc44ce7e-7bc3-42c0-9f4c-680c19f0390a): created successfully Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47149c1c-4241-44ca-91a7-c490b449f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (7a31aadc-bfaf-45dd-b4cc-2798f25cdb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:01 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-24ff6727-e623-40f4-8a9e-6b8cbcdf1014 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created volume successfully. Apr 09 17:41:01 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9.663486fc-170f-4b38-860a-3ec48bb05de8" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-663486fc-170f-4b38-860a-3ec48bb05de8" released by "_delete_snapshot" :: held 2.087s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" released by "delete_snapshot" :: held 2.100s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['cb0ec57e-cab8-4d2e-9740-3bf54843fc2c', '44539808-47ed-4cf3-a720-1d83c0c2e450', '196e70de-988a-41ae-94a1-ee32ff52b426', 'f5162df3-ceba-4b50-ab07-bff367765b63'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:01 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Delete snapshot completed successfully. Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b2b28bcd-fce8-43c9-83fe-7641421def0f tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-663486fc-170f-4b38-860a-3ec48bb05de8-delete_snapshot" released by "delete_snapshot" :: held 2.183s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:01 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:01 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8 Apr 09 17:41:01 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:01 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 1073741824" returned: 0 in 0.550s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:01 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:01 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 Apr 09 17:41:01 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:02 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49.106b884a-1de7-439d-b4b0-3396bf95e6f8" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-106b884a-1de7-439d-b4b0-3396bf95e6f8" released by "_delete_snapshot" :: held 2.036s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-0f8983f2-1844-4298-9872-9fe2843f6b49" released by "delete_snapshot" :: held 2.045s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Created reservations ['ecb502b3-16b9-4888-905a-ba61fa1a5107', 'c06690cd-2e63-4153-a7d3-4840b182c3fa', '203a5f5e-7db3-4040-b89c-a9c41c6e3242', 'ca7a838d-8aaa-4347-b779-3fd6edb7a88d'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:02 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Delete snapshot completed successfully. Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d898b31c-f1fa-4b96-bcdf-6afabc6aad5f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-106b884a-1de7-439d-b4b0-3396bf95e6f8-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:02 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245" returned: 0 in 0.450s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.887s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694528301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd74942-9e49-4a4c-b95a-396bca1ea7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:55Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Creating volume 7cd74942-9e49-4a4c-b95a-396bca1ea7de {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:41:02 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d5ce24-b21f-440c-a46e-7f48b3d59511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:02 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de 1073741824 Apr 09 17:41:02 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05f1e26-fef9-4304-8749-b4c6eded8b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:02 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 (b796d01a-0c4a-4f2b-a3e0-da95f19a8245): created successfully Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05f1e26-fef9-4304-8749-b4c6eded8b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (6679196f-b58e-4d3a-b800-096da0f80677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:02 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-81ee49a1-8ca4-4c37-aab4-65719c9b1849 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created volume successfully. Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "cinder-quobyte-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a611788-ab5e-4e1a-bd52-172774cf5454]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:02 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 Apr 09 17:41:02 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:02 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de 1073741824" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:02 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:02 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de Apr 09 17:41:02 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:03 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:03 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9 Apr 09 17:41:03 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-0f8983f2-1844-4298-9872-9fe2843f6b49-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-0f8983f2-1844-4298-9872-9fe2843f6b49-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:03 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de" returned: 0 in 0.466s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.699s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356826527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c7299d-55cb-4097-bd7c-f88e6d7d9d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8865e8be53e1495d86c5ad305b0c258e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:40:56Z,use_quota=True,user_id='174e7f535bb1454882f9b4caee1b7245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Creating volume 64c7299d-55cb-4097-bd7c-f88e6d7d9d23 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:41:03 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:03 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 1073741824 Apr 09 17:41:03 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-quobyte-0f8983f2-1844-4298-9872-9fe2843f6b49" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3439cfa1-b350-44f1-b27c-8571874d36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232bca24-5c93-454d-9e75-d661793521a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-0f8983f2-1844-4298-9872-9fe2843f6b49" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:03 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de (7cd74942-9e49-4a4c-b95a-396bca1ea7de): created successfully Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232bca24-5c93-454d-9e75-d661793521a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (31498865-e2aa-465b-9b75-d0f8f98ae01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6311edaf-ef16-4feb-ae6f-b31d25b121c2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:03 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-9a8b14f9-7a78-43dc-9c23-6e6e61f66ad4 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created volume successfully. Apr 09 17:41:03 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:41:03 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:03 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" returned: 0 in 0.462s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-quobyte-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9" released by "delete_volume" :: held 0.984s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Created reservations ['bc254341-e336-4433-b735-f805fcb97846', '51891eaf-af68-4f63-a53e-0e689053b0fc', 'ac3752ce-9620-4385-a611-d6655924ca75', 'e727755b-c4d2-4e82-98e5-4185efa65658'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:03 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:03 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:03 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:03 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 1073741824" returned: 0 in 0.549s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:04 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 Apr 09 17:41:04 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:04 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.566s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:04 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49 Apr 09 17:41:04 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:04 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.535s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Deleted volume successfully. Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-4b0dc7f9-75eb-43ab-a4ca-f08e553ead9a tempest-CreateVolumesFromSnapshotTest-264493962 None] Lock "cinder-4dfc1d08-7c0a-43d8-b8a1-04a71837c5c9-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:04 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-0f8983f2-1844-4298-9872-9fe2843f6b49" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-0f8983f2-1844-4298-9872-9fe2843f6b49" released by "delete_volume" :: held 1.095s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:04 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23" returned: 0 in 0.591s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.577s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:04 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Cloning volume 7e30b7cd-802b-4116-b271-60d7657f7e29 to volume 6f2dddf8-0473-4e50-9be6-83c72411948a Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Created reservations ['0dcd49e0-aff9-4687-a30e-59f4f8b4e842', '29cb66d8-e487-4635-a45a-a804eb1f6976', '6d7d09f3-6879-4cdc-8442-b6c2cbbfbd7f', '3435de37-bcec-4449-a454-14c03914ad3e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68002c40-05b3-45ae-aa88-31104dcde4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1f53a3-f160-4504-8ab2-a33562985d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:04 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Volume volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 (64c7299d-55cb-4097-bd7c-f88e6d7d9d23): created successfully Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1f53a3-f160-4504-8ab2-a33562985d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Flow 'volume_create_manager' (a0486038-86bf-404f-898f-87b4da2d18e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:04 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-981e44aa-45eb-472a-8df7-314f83e51a0d tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created volume successfully. Apr 09 17:41:04 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:04 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Creating offline snapshot 1dc24a4b-3ae7-4cb2-959d-0119b1586996 of volume 7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa66f015-0389-4d42-b65b-b39485fdcf9a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:04 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:04 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:41:04 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:05 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.451s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:05 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Deleted volume successfully. Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-107d84d7-783e-471c-8b60-528d2cbfaa8f tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-0f8983f2-1844-4298-9872-9fe2843f6b49-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:05 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.529s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:05 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 1G Apr 09 17:41:05 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-856980eb-cad8-4752-a3c5-e7597e887cfb-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Flow 'volume_create_manager' (5cc011db-2381-4763-9b11-3611a42ed409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4ff91b-d72f-41bf-8fb4-b701003a0d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-64c7299d-55cb-4097-bd7c-f88e6d7d9d23-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-856980eb-cad8-4752-a3c5-e7597e887cfb-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4ff91b-d72f-41bf-8fb4-b701003a0d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a1bdee-0cee-4e92-9183-f083dba3e0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c179fc642c16454391cf061f81e1eedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:41:06Z,use_quota=True,user_id='95459e9e790a4b27b5118c6cc3166ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0678e1-fce9-4374-af84-abfd15ec862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0678e1-fce9-4374-af84-abfd15ec862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5746db5a-2695-4875-859f-fffaa4480873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5746db5a-2695-4875-859f-fffaa4480873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a1bdee-0cee-4e92-9183-f083dba3e0ea', 'volume_name': 'volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8be2ec-50e9-47ba-86f7-0b7bfbf02cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8be2ec-50e9-47ba-86f7-0b7bfbf02cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92799cc4-4d49-44a0-944d-a6991d35f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:05 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Volume 66a1bdee-0cee-4e92-9183-f083dba3e0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea', 'volume_size': 1} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-64c7299d-55cb-4097-bd7c-f88e6d7d9d23-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "cinder-quobyte-856980eb-cad8-4752-a3c5-e7597e887cfb" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-quobyte-64c7299d-55cb-4097-bd7c-f88e6d7d9d23" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-856980eb-cad8-4752-a3c5-e7597e887cfb" acquired by "delete_volume" :: waited 0.020s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[27843a1e-1032-438a-8a38-d7ead441ca80]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-64c7299d-55cb-4097-bd7c-f88e6d7d9d23" acquired by "delete_volume" :: waited 0.026s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce125558-d571-4e8e-a8c0-6b6d5c667f11]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:05 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb Apr 09 17:41:05 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:05 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 1G" returned: 0 in 0.588s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:05 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e30b7cd-802b-4116-b271-60d7657f7e29 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:05 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 Apr 09 17:41:05 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:05 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e30b7cd-802b-4116-b271-60d7657f7e29 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 Apr 09 17:41:05 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:06 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:06 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb" returned: 0 in 0.494s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:06 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:06 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23 Apr 09 17:41:06 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e30b7cd-802b-4116-b271-60d7657f7e29 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:06 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 is being set with open permissions: ugo+rw Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:06 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb Apr 09 17:41:06 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:06 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 Apr 09 17:41:06 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:06 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-856980eb-cad8-4752-a3c5-e7597e887cfb" returned: 0 in 0.410s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:06 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-64c7299d-55cb-4097-bd7c-f88e6d7d9d23" returned: 0 in 0.428s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-quobyte-856980eb-cad8-4752-a3c5-e7597e887cfb" released by "delete_volume" :: held 0.933s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-64c7299d-55cb-4097-bd7c-f88e6d7d9d23" released by "delete_volume" :: held 0.939s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:06 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996" returned: 0 in 0.447s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Created reservations ['273b92f2-1ab0-41fd-8e58-f7e59665acda', 'b77e29ab-e378-405b-b1aa-c2f75222ff61', '0002308c-1baf-425f-8266-9e424d2ec365', 'd72b9732-a690-4fb1-9d20-2bd39e57473e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:06 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info Apr 09 17:41:06 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created reservations ['699c9041-fc9d-4216-8555-30e65652a931', '5324a4a3-62af-4603-8e8f-104d2554c802', '8a776817-0141-47b9-af13-2be2cd0ef51f', '977370c5-cea0-4d3c-8486-f6ae6c24a75c'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:06 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:06 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:06 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:06 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:06 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:07 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info" returned: 0 in 0.418s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:07 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info is being set with open permissions: ugo+rw Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:07 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info Apr 09 17:41:07 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:07 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.426s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:07 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Deleted volume successfully. Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-d1490146-1ef0-4363-a7ab-afac8233e047 tempest-SnapshotDependencyTests-173858327 None] Lock "cinder-856980eb-cad8-4752-a3c5-e7597e887cfb-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:07 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.421s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:07 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Deleted volume successfully. Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a0f17ea1-18c5-491d-bda6-5e68ab68c011 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-64c7299d-55cb-4097-bd7c-f88e6d7d9d23-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:07 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.info" returned: 0 in 0.429s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-6f2dddf8-0473-4e50-9be6-83c72411948a" by "_copy_volume_from_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-6f2dddf8-0473-4e50-9be6-83c72411948a" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] snapshot: 1dc24a4b-3ae7-4cb2-959d-0119b1586996, volume: 6f2dddf8-0473-4e50-9be6-83c72411948a, {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9650533-373f-444a-bed1-a79fa65ac689]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:07 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 Apr 09 17:41:07 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-7cd74942-9e49-4a4c-b95a-396bca1ea7de-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-7cd74942-9e49-4a4c-b95a-396bca1ea7de-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-quobyte-7cd74942-9e49-4a4c-b95a-396bca1ea7de" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-7cd74942-9e49-4a4c-b95a-396bca1ea7de" acquired by "delete_volume" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[212193b9-9036-41f2-88b7-1f725db0a60b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:07 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:07 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de Apr 09 17:41:07 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:08 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996" returned: 0 in 0.523s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e30b7cd-802b-4116-b271-60d7657f7e29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Creating direct copy from snapshot {{(pid=82701) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f627afa-a19f-418c-9a84-1f97570ed775]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_service.periodic_task [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82701) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:08 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:08 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:08 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:41:08 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:08 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de" returned: 0 in 0.521s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:08 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de Apr 09 17:41:08 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:08 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.509s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-d20f0d7b-6cbe-43a4-a2ff-2be7d21491c8 None None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:08 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.615s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.utils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Path /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a not found in is_blk_device check {{(pid=82701) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:08 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a Apr 09 17:41:08 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:08 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7cd74942-9e49-4a4c-b95a-396bca1ea7de" returned: 0 in 0.482s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-7cd74942-9e49-4a4c-b95a-396bca1ea7de" released by "delete_volume" :: held 1.027s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created reservations ['fced48ee-3a12-426a-b303-039bae50648e', 'ee6a9b78-95d5-4cae-8e2b-c73f26a91898', '484b41a0-fa29-48ef-8f50-4ec763f09e77', '46f1d7b9-7fd3-49d3-8096-90d4f06a67b4'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:08 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:09 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:09 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:09 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:09 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.850s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:09 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:09 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Deleted volume successfully. Apr 09 17:41:09 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b525e845-8a33-4cd1-b386-50348285124c tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-7cd74942-9e49-4a4c-b95a-396bca1ea7de-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-b796d01a-0c4a-4f2b-a3e0-da95f19a8245-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-b796d01a-0c4a-4f2b-a3e0-da95f19a8245-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-quobyte-b796d01a-0c4a-4f2b-a3e0-da95f19a8245" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:10 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-b796d01a-0c4a-4f2b-a3e0-da95f19a8245" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:10 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1728d-98b3-4074-b123-8493228b5a61]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:10 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:10 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 Apr 09 17:41:10 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:11 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a" returned: 0 in 2.392s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d34842-813b-4d50-ae34-e38d1fe507ba]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:11 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:41:11 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:11 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245" returned: 0 in 1.100s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:11 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245 Apr 09 17:41:11 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:11 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-b796d01a-0c4a-4f2b-a3e0-da95f19a8245" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-b796d01a-0c4a-4f2b-a3e0-da95f19a8245" released by "delete_volume" :: held 1.569s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created reservations ['54afd685-0c69-4bc8-a8d4-b981a3e8ebc3', '4465e0a4-c5ed-4bdb-bd4a-90a63cc1331f', 'dc07fe9d-b170-4b98-a08d-202e7beb98fb', 'a2039b8d-3aa9-4b3d-983a-293e07afdfaa'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:11 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.674s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG cinder.image.image_utils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Image conversion details: src /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a {{(pid=82701) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 17:41:11 devstack cinder-volume[82701]: INFO cinder.image.image_utils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Converted 1024.00 MB image at 427.69 MB/s Apr 09 17:41:11 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a is being set with open permissions: ugo+rw Apr 09 17:41:11 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:11 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:11 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:11 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a Apr 09 17:41:11 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:12 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a" returned: 0 in 0.452s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-6f2dddf8-0473-4e50-9be6-83c72411948a" released by "_copy_volume_from_snapshot" :: held 4.713s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-1dc24a4b-3ae7-4cb2-959d-0119b1586996" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:12 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.514s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:12 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Deleted volume successfully. Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-1dc24a4b-3ae7-4cb2-959d-0119b1586996" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Deleting offline snapshot 1dc24a4b-3ae7-4cb2-959d-0119b1586996 of volume 7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] snapshot_file for this snap is: volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d32be-c5b8-43a2-92a2-2927fd5cd4f6]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a9d8574b-b139-4e07-acd1-9387338f520f tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-b796d01a-0c4a-4f2b-a3e0-da95f19a8245-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-quobyte-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e1d6d-0ee3-4e24-a461-9a97ae2ff531]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:12 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 Apr 09 17:41:12 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:12 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a Apr 09 17:41:12 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:12 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996" returned: 0 in 0.531s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e30b7cd-802b-4116-b271-60d7657f7e29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3c818-d6fe-4c50-8468-c6e504fdb447]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:12 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:13 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a" returned: 0 in 0.545s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:13 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:41:13 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:13 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a Apr 09 17:41:13 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:13 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a" returned: 0 in 0.531s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:13 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.599s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a" released by "delete_volume" :: held 1.112s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:13 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 Apr 09 17:41:13 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created reservations ['3cb7be08-bc33-4b5e-b5f9-93f2496b30a4', '0ac1e4cd-bd0a-4470-9c39-1ef134c17b57', '81e461ec-fd0d-4ecb-86c9-994437efda21', '36ae47d4-6825-49f8-b9c3-26bacca976f0'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:13 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:13 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:13 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:14 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996" returned: 0 in 0.527s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:14 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996 Apr 09 17:41:14 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:14 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.474s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:14 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Deleted volume successfully. Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-1aefd212-2b3a-4b1e-ae15-c68aced422ea tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-dc44ce7e-7bc3-42c0-9f4c-680c19f0390a-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-15b5f01e-30d0-42d8-be93-502f913d8afa-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-15b5f01e-30d0-42d8-be93-502f913d8afa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:14 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29.1dc24a4b-3ae7-4cb2-959d-0119b1586996" returned: 0 in 0.478s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-1dc24a4b-3ae7-4cb2-959d-0119b1586996" released by "_delete_snapshot" :: held 2.206s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-quobyte-15b5f01e-30d0-42d8-be93-502f913d8afa" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.030s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-15b5f01e-30d0-42d8-be93-502f913d8afa" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.941s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a1bdee-0cee-4e92-9183-f083dba3e0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c179fc642c16454391cf061f81e1eedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:41:06Z,use_quota=True,user_id='95459e9e790a4b27b5118c6cc3166ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Creating volume 66a1bdee-0cee-4e92-9183-f083dba3e0ea {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:41:14 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87c2fb-c3af-463c-ad86-8e88f8f30ee2]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:14 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea 1073741824 Apr 09 17:41:14 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15e1cd9-ff50-4637-b65b-9d4d7e87e9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2dddf8-0473-4e50-9be6-83c72411948a', 'volume_size': 1, 'source_volid': '7e30b7cd-802b-4116-b271-60d7657f7e29', 'source_volstatus': 'available'}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc4a96d-32d4-4a26-a37b-42952138f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:14 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Volume volume-6f2dddf8-0473-4e50-9be6-83c72411948a (6f2dddf8-0473-4e50-9be6-83c72411948a): created successfully Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc4a96d-32d4-4a26-a37b-42952138f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:14 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Flow 'volume_create_manager' (9b3ee7ed-1214-4158-ab7e-21c32fe10976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:14 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-da853452-2d6c-4955-bf2e-e8ead237eb57 tempest-VolumeDependencyTests-964238354 None] Created volume successfully. Apr 09 17:41:14 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa Apr 09 17:41:14 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:15 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea 1073741824" returned: 0 in 0.508s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:15 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa" returned: 0 in 0.511s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:15 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa Apr 09 17:41:15 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:15 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea Apr 09 17:41:15 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-7e30b7cd-802b-4116-b271-60d7657f7e29-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-7e30b7cd-802b-4116-b271-60d7657f7e29-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-7e30b7cd-802b-4116-b271-60d7657f7e29" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-7e30b7cd-802b-4116-b271-60d7657f7e29" acquired by "delete_volume" :: waited 0.006s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae8e95-a415-4fc0-af63-f507c32fe918]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:15 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:41:15 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:15 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-15b5f01e-30d0-42d8-be93-502f913d8afa" returned: 0 in 0.434s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-15b5f01e-30d0-42d8-be93-502f913d8afa" released by "delete_volume" :: held 0.992s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:15 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea" returned: 0 in 0.458s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created reservations ['8d1972eb-1c62-4ab6-ba46-1adc716467f2', '96859f42-5ef0-4076-860f-2adc2cad8a9d', '6015c641-c42d-4d0d-95ea-4927d2b4f100', 'c6c4be34-fc18-49a7-9ffd-7982b64ae86e'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92799cc4-4d49-44a0-944d-a6991d35f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36584f1-d4db-4cb3-b55c-8317fe29bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:15 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Volume volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea (66a1bdee-0cee-4e92-9183-f083dba3e0ea): created successfully Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36584f1-d4db-4cb3-b55c-8317fe29bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Flow 'volume_create_manager' (5cc011db-2381-4763-9b11-3611a42ed409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:15 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-044026ba-7d03-4ab8-aee6-2ebc78bb2a0c tempest-CinderUnicodeTest-865535710 None] Created volume successfully. Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:15 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:15 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:15 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.490s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:15 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:15 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29 Apr 09 17:41:15 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:16 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.400s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:16 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Deleted volume successfully. Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-3de8c83b-4ec5-4536-aaa3-2f3cc5de2676 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-15b5f01e-30d0-42d8-be93-502f913d8afa-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:16 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-7e30b7cd-802b-4116-b271-60d7657f7e29" returned: 0 in 0.408s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-7e30b7cd-802b-4116-b271-60d7657f7e29" released by "delete_volume" :: held 0.926s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Created reservations ['91bc1460-27d7-4cbd-98e4-59a927c173fc', '3193fced-5051-4273-b43b-bcb761b7041b', '903e74bb-48de-4d5c-8736-5a2b30b8e7b2', '4a0b4e73-e368-4127-8468-34efc20313f7'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:16 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:16 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-6f2dddf8-0473-4e50-9be6-83c72411948a-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Lock "cinder-6f2dddf8-0473-4e50-9be6-83c72411948a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-6f2dddf8-0473-4e50-9be6-83c72411948a" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-6f2dddf8-0473-4e50-9be6-83c72411948a" acquired by "delete_volume" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee8396e-24e8-4226-8d0c-276cf1d1345c]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:16 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a Apr 09 17:41:16 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.flows.manager.create_volume [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82701) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Flow 'volume_create_manager' (531ae6d8-24b4-47d4-b248-20d6d0abacce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c39f53-99fa-468b-bc33-ce72b549d02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c39f53-99fa-468b-bc33-ce72b549d02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:41:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1106961204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6146aaf4-2647-422d-af8e-04ae003267e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c179fc642c16454391cf061f81e1eedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:41:17Z,use_quota=True,user_id='95459e9e790a4b27b5118c6cc3166ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c2e3f7-e179-411f-9ab8-0955d2226bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c2e3f7-e179-411f-9ab8-0955d2226bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8413e12-e7a0-422b-b31a-8f4333d0feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8413e12-e7a0-422b-b31a-8f4333d0feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6146aaf4-2647-422d-af8e-04ae003267e1', 'volume_name': 'volume-6146aaf4-2647-422d-af8e-04ae003267e1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249a5a3a-d65e-4924-9b12-bf2e9c4e51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249a5a3a-d65e-4924-9b12-bf2e9c4e51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210ec604-9692-4717-978d-9fe34a80749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:16 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Volume 6146aaf4-2647-422d-af8e-04ae003267e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6146aaf4-2647-422d-af8e-04ae003267e1', 'volume_size': 1} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T15:41:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1106961204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6146aaf4-2647-422d-af8e-04ae003267e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c179fc642c16454391cf061f81e1eedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T15:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T15:41:17Z,use_quota=True,user_id='95459e9e790a4b27b5118c6cc3166ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4c911aa-d540-4d28-b4bf-f9f38a2a2677),volume_type_id=b4c911aa-d540-4d28-b4bf-f9f38a2a2677)}" {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Creating volume 6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Selected osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 as target Quobyte volume. {{(pid=82701) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 17:41:16 devstack cinder-volume[82701]: INFO cinder.volume.drivers.remotefs [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] casted to osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6 Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 1073741824 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-70f20a2d-a2ca-41fb-b734-1d01ab533ef5-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-70f20a2d-a2ca-41fb-b734-1d01ab533ef5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:16 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 1073741824 Apr 09 17:41:16 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "cinder-quobyte-70f20a2d-a2ca-41fb-b734-1d01ab533ef5" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-70f20a2d-a2ca-41fb-b734-1d01ab533ef5" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a24e3-60a5-4d65-86d6-c5308bf6c72b]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:16 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.500s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:16 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Deleted volume successfully. Apr 09 17:41:16 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-320bdb95-1e90-41b1-8090-7f7ef44eae43 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-7e30b7cd-802b-4116-b271-60d7657f7e29-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:16 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 Apr 09 17:41:16 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:17 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a" returned: 0 in 0.541s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:17 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a Apr 09 17:41:17 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:17 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 1073741824" returned: 0 in 0.533s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:17 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5 Apr 09 17:41:17 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:17 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 Apr 09 17:41:17 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:17 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6f2dddf8-0473-4e50-9be6-83c72411948a" returned: 0 in 0.422s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-6f2dddf8-0473-4e50-9be6-83c72411948a" released by "delete_volume" :: held 0.985s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Created reservations ['1f053056-ab71-4760-ac65-96c6894cb606', '4a4edebe-3e84-4339-8238-598fbd6641c6', 'a5509c67-3f9a-401c-8e5d-db47a75ac043', '342f9b09-7622-4f0b-92f0-ecaae33c1afb'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:17 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:17 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:17 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1" returned: 0 in 0.418s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'} {{(pid=82701) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:17 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-70f20a2d-a2ca-41fb-b734-1d01ab533ef5" returned: 0 in 0.445s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-quobyte-70f20a2d-a2ca-41fb-b734-1d01ab533ef5" released by "delete_volume" :: held 0.939s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210ec604-9692-4717-978d-9fe34a80749d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6146aaf4-2647-422d-af8e-04ae003267e1', 'volume_size': 1}' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52e7828-d006-4552-a00c-c1fe4a239be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 17:41:17 devstack cinder-volume[82701]: INFO cinder.volume.flows.manager.create_volume [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Volume volume-6146aaf4-2647-422d-af8e-04ae003267e1 (6146aaf4-2647-422d-af8e-04ae003267e1): created successfully Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52e7828-d006-4552-a00c-c1fe4a239be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82701) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Flow 'volume_create_manager' (531ae6d8-24b4-47d4-b248-20d6d0abacce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82701) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 17:41:17 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-54167cb3-88d1-42f7-bcca-fee4ac410183 tempest-CinderUnicodeTest-865535710 None] Created volume successfully. Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Created reservations ['745836b6-5947-4547-bb8e-f046118f6938', 'e32dabda-ad35-4bff-8b3e-13c4ef55899d', '96be541d-fb09-4bff-bacd-c3448cbb519b', 'c6152865-e042-471b-a9c6-76305b8037e4'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:17 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:17 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:17 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.457s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:17 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Deleted volume successfully. Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5d1c80b1-4ce5-4b18-bfb4-33a190114edb tempest-VolumeDependencyTests-964238354 None] Lock "cinder-6f2dddf8-0473-4e50-9be6-83c72411948a-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:18 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.473s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:18 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Deleted volume successfully. Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-ecbf15f7-7ee2-4869-8c5c-fa129cef7248 tempest-CreateVolumesFromSourceVolumeTest-2077419788 None] Lock "cinder-70f20a2d-a2ca-41fb-b734-1d01ab533ef5-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-e4a4c1b8-b375-4698-9539-75b5d9350dd6-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-e4a4c1b8-b375-4698-9539-75b5d9350dd6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "cinder-quobyte-e4a4c1b8-b375-4698-9539-75b5d9350dd6" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-e4a4c1b8-b375-4698-9539-75b5d9350dd6" acquired by "delete_volume" :: waited 0.010s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[93685586-30bf-431e-a1f4-1c570884486a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:18 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 Apr 09 17:41:18 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Creating offline snapshot facb22b7-709d-4aa6-93b5-6f305375bdbf of volume 6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2896fbc-e938-462b-80ea-74cea6a6f05a]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:18 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:18 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 Apr 09 17:41:18 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:19 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6" returned: 0 in 0.505s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:19 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6 Apr 09 17:41:19 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:19 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1" returned: 0 in 0.492s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf 1G {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:19 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf 1G Apr 09 17:41:19 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:19 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-e4a4c1b8-b375-4698-9539-75b5d9350dd6" returned: 0 in 0.413s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-quobyte-e4a4c1b8-b375-4698-9539-75b5d9350dd6" released by "delete_volume" :: held 0.955s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Created reservations ['53f1ece2-0148-4111-9ff3-1bfdb7a4717b', '07716477-399e-49d2-8569-08ef1aaf9910', '17bd0109-8839-4240-8658-e82f108fd9e8', '771d78c9-dcf1-47de-9299-32d6cc424698'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:19 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:19 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:19 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf 1G" returned: 0 in 0.527s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:19 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6146aaf4-2647-422d-af8e-04ae003267e1 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:19 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6146aaf4-2647-422d-af8e-04ae003267e1 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf Apr 09 17:41:19 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:20 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.461s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:20 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Deleted volume successfully. Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-b08cc5e0-e9a3-4b83-9bfd-c8aa0a557195 tempest-VolumeDependencyTests-964238354 None] Lock "cinder-e4a4c1b8-b375-4698-9539-75b5d9350dd6-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:20 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6146aaf4-2647-422d-af8e-04ae003267e1 -F qcow2 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf" returned: 0 in 0.453s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:20 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf is being set with open permissions: ugo+rw Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:20 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf Apr 09 17:41:20 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:20 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:20 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:20 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info Apr 09 17:41:20 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:21 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info" returned: 0 in 0.397s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:21 devstack cinder-volume[82701]: WARNING cinder.volume.drivers.remotefs [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info is being set with open permissions: ugo+rw Apr 09 17:41:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:21 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info Apr 09 17:41:21 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:21 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.info" returned: 0 in 0.406s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:21 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:21 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-4220b246-dca3-411d-a754-f89177701e63 tempest-CinderUnicodeTest-865535710 None] Create snapshot completed successfully Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-facb22b7-709d-4aa6-93b5-6f305375bdbf-delete_snapshot" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Lock "cinder-facb22b7-709d-4aa6-93b5-6f305375bdbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-quobyte-6146aaf4-2647-422d-af8e-04ae003267e1" by "delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-6146aaf4-2647-422d-af8e-04ae003267e1" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-quobyte-facb22b7-709d-4aa6-93b5-6f305375bdbf" by "_delete_snapshot" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-facb22b7-709d-4aa6-93b5-6f305375bdbf" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Deleting offline snapshot facb22b7-709d-4aa6-93b5-6f305375bdbf of volume 6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] snapshot_file for this snap is: volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf {{(pid=82701) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059b71b-be56-4926-8945-ac7ef5549941]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:22 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf Apr 09 17:41:22 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:22 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf" returned: 0 in 0.469s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.remotefs [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6146aaf4-2647-422d-af8e-04ae003267e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82701) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cacec2-40e9-4434-9489-eec4cbc44d80]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:22 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:22 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 Apr 09 17:41:22 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:23 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1" returned: 0 in 0.448s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:23 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf Apr 09 17:41:23 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:23 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf" returned: 0 in 0.432s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:23 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf Apr 09 17:41:23 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:23 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1.facb22b7-709d-4aa6-93b5-6f305375bdbf" returned: 0 in 0.403s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=190,cinder:UPDATE=293,cinder:INSERT=56,cinder:DELETE=28 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:UPDATE=270,cinder:SELECT=212,cinder:DELETE=24,cinder:INSERT=77 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-facb22b7-709d-4aa6-93b5-6f305375bdbf" released by "_delete_snapshot" :: held 1.814s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-6146aaf4-2647-422d-af8e-04ae003267e1" released by "delete_snapshot" :: held 1.828s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Created reservations ['784fe9d8-aa10-480a-841c-61ab80bce6ce', 'd672d471-b548-4357-bf35-a908399242d0', '14776f72-3a1c-4778-bd4b-03362eece0cc', '96d51a4b-3b76-465d-8a65-9e8e57029ce8'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:23 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Delete snapshot completed successfully. Apr 09 17:41:23 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-e336e73c-099d-45b1-8efb-f67d35ee1dff tempest-CinderUnicodeTest-865535710 None] Lock "cinder-facb22b7-709d-4aa6-93b5-6f305375bdbf-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-6146aaf4-2647-422d-af8e-04ae003267e1-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-6146aaf4-2647-422d-af8e-04ae003267e1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-quobyte-6146aaf4-2647-422d-af8e-04ae003267e1" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-6146aaf4-2647-422d-af8e-04ae003267e1" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1b90ee-540c-4ca3-a7c0-5f2483e9fd22]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:24 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 Apr 09 17:41:24 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:24 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1" returned: 0 in 0.455s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:24 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:24 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1 Apr 09 17:41:24 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:25 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-6146aaf4-2647-422d-af8e-04ae003267e1" returned: 0 in 0.399s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-6146aaf4-2647-422d-af8e-04ae003267e1" released by "delete_volume" :: held 0.891s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Created reservations ['9b77c16f-cd54-424c-a985-6d3440e28260', '96c89bb2-dd6e-496c-900e-0695c1f76c2b', '97a23b63-17e9-4177-9613-2d568d2c13af', '67281ddb-31fd-4129-9715-0aa64651fa6a'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:25 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:25 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-66a1bdee-0cee-4e92-9183-f083dba3e0ea-delete_volume" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-66a1bdee-0cee-4e92-9183-f083dba3e0ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "cinder-quobyte-66a1bdee-0cee-4e92-9183-f083dba3e0ea" by "delete_volume" {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-66a1bdee-0cee-4e92-9183-f083dba3e0ea" acquired by "delete_volume" :: waited 0.007s {{(pid=82701) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4b3613-f79d-4117-8120-92210d8b00cf]: (4, 'qcow2') {{(pid=83627) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:25 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea Apr 09 17:41:25 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:25 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.429s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:25 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Deleted volume successfully. Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-a00a5ccf-30cc-490e-afab-192f4c929275 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-6146aaf4-2647-422d-af8e-04ae003267e1-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:25 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea" returned: 0 in 0.502s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:25 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:25 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea Apr 09 17:41:25 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:26 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac/volume-66a1bdee-0cee-4e92-9183-f083dba3e0ea" returned: 0 in 0.397s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-quobyte-66a1bdee-0cee-4e92-9183-f083dba3e0ea" released by "delete_volume" :: held 0.919s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG cinder.quota [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Created reservations ['6d95776f-ab3f-4822-9f56-24a70f3bf0b7', '3daa93b3-c195-4946-a67e-7e44e793a061', '0e77a95b-6852-43d1-bae4-aeb2352b3bf7', '6abb4f4c-7674-4c85-a01f-25ade16c3c71'] {{(pid=82701) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6': None} {{(pid=82701) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG cinder.volume.drivers.quobyte [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f37b9b3b-0c00-4c5e-b7d8-40efe9d2c1d6'] {{(pid=82701) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.lockutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82701) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 17:41:26 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac Apr 09 17:41:26 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 17:41:26 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG oslo_concurrency.processutils [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c5dfbf9005ed89bf37539b8cad2389ac" returned: 0 in 0.467s {{(pid=82701) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG cinder.manager [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Notifying Schedulers of capabilities ... {{(pid=82701) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 17:41:26 devstack cinder-volume[82701]: INFO cinder.volume.manager [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Deleted volume successfully. Apr 09 17:41:26 devstack cinder-volume[82701]: DEBUG cinder.coordination [None req-5ec5de7b-731d-4c6f-94ea-7a5c062a6627 tempest-CinderUnicodeTest-865535710 None] Lock "cinder-66a1bdee-0cee-4e92-9183-f083dba3e0ea-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82701) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 17:41:36 devstack cinder-volume[82701]: DEBUG dbcounter [-] [82701] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=82701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}